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ABSTRACT « 

The appendixes to the final evaluation report of 
Besearch for Better Schools' eiployer7ha9ea career education, program 
contain: a listing of TT. I97a evaluation reports^ an explanation of 
evaluation instruients and "kesib procedures^ the evaluation 
instruments (student deiio^raphic data questionnaire^ student opinion 
survey, parent opinion sunrey, experience resource site deiographic* 
data questionnaire, cluster test of knowledge, assessment of student 
attit^udes scale, careet exploration student questionnaire, and 
employer questionnaire) , and the procedural audi* report. (J?) 



♦ Documents acquireoT^y EFIC Include many informal unpublished 

♦ materials not available from other sources. BRIC makes every effort 

♦ to obtain the best copy available. Nevertheless, items of marginal 

♦ reproducibility are often encountered and this affects the quality 

♦ of the Microfiche and hardcopy reproductions ERIC makes available 

♦ via the ERIC Document Reproduction Service (BDRS) . EDPS is not 

♦ responsible for the quality of the original document. Reproductions 

♦ supplied by EDRS are the best that can be made from the original. 



er|c 



- 1 



RESEARCH FOR BETTER SCHP^^tS^^ 







- •! ■ 



FY 1974 






^^^^^^^> V II 




1^ ! CN- 



-i^s^'''^ " '" "' ^S^ ** ^^^^t^^ ^^tMtf ' 



-2- 



FY 197^^ Evaluation 'Reports 



Formative Reports 



1. . 


15A1 


2. 


■ lOCl 


3. 


12dC1 






5. 


-J 58-1 


6. 


nci 


7. 


12fC2 


8. 


13C1 


9. 


15C1 



Instructional Systems Design 
Employer Support Evaluation 
Guidance Evaluation I '7 
Basic Skills Evaluation 
Instructional Systems Field Test 
Employer Utilization Evaluation 
Guidance Evaluation tl 
Career pcvelopment Evaluation 
Instructional Systems Evaluation 



Summative Reports • * ^ 

10« Report on Management Systems Components 

IK Report on Support Systems Components 

12. Interim •E>?aluation^Report 

13. Book of Measures 

Ti^. Final Evaluation Report 
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Special Evaluation Reports 

J5. Report on Recruitment and Selection 

16. Report on Student Characteristics 

17. Report on Instructional Units for Fifth Quarter 

. 18. .Report to Employer-Coordinator on Results of Sixth 
Quarter Interviews ^ 
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INSTRUMENTS AND PROCEDURES " ' . 

Each of the student groups described In Student Population was 

, ' 7 

adfujnlstcrcd a series of Instrumerfts In a pretest-posttest design 
covering the 1973-197^ academic year. In addition, the experimental 
groups have been administered various tes)ts aqd surveys during the- 
course of the year. 



Pre tesfPosttest Instruments 

• , * . ^ 

The roi lowing Instruments were included .a the prctest-posttest 

deslgnr^ They-werc administered* to both experimental and control ^„ . 

groups. Their primary use was Intended to be In summatlve evaluation; 

al though they \\ay/e some fArmatWe* ut H i ty . ' ^ 

\ ' : - : ■ 

%' 

1. Comprehensive Tests of Basic Skills (CTBS) - This instrument mea- 
/sures traditional academic skills. The Reading and Arithmetic sub 

tests were used, y4elding,the following scores: Reading 
yocabulary,^ Reading Comprehension, Reading Total, Arithmetic 
- Computation, Arltljmetlc Concepts, Arithmetic Applications ancf 
Arithmetic Total. The Instrument has been well devejoped 
and documented, but Is subject to the usual Insensl tlvltles 
of standardized Instruments. (Instrument available commerclany) . 

2. Career MaturKtv- Inventory (CMI) - This Instrument was designed 
to measure Career Attitude and a set of career competencies: 
Self Appraisal, Occupational Information, Goal Selection, 

V Planning and Problem Solving. The Self-^ppralsal subtest was 
not administered. This Instrument has been well developed 

<^ but not extensively researched and. documented. (Instrument 

available commercially). ' \ 

3. Assessment of Student Attitudes questionnaire (ASA) - This 
Instrument has been designed by RBS staff to measure attitudes 
toward several elements In the leaTn-lng environment: Education 
in General, School Curriculum, School 'Resources and School - 
Counseling. This lns1:rument Is still In the development 

^ stag*^ and extensive data are being gathered on Its performance; 

' technical reports are avallabl^.„ (See Appendix C). 



.Student Deqiographtc Data {Questionnaire (SDQ) ^ Thts Instru- 
/ment was constructed by the evaluation staffs 6f all Experience 

^Based Career Education projects' li^rov I de" common data 'on 

basic characteristics* This questlpnnalre Includes: Name, v 
• Sex, Birth Date, Race, ^Grade Level, rdst" Secondary Wans, - 
^Parents Educafton Lev«l, farent Occupations, Sendlrrg Sfcfiool 

Grades and Sending School Attendahce* (See Appendix C)*. 



'dther Instruments , * ^ ' 

♦ • 

* Another .series of Instruments -has been established for the purt: 
pose of assessing experimental students only. Although, the resuFts of 
these measures may have s^ummative evaluation Implication, no com- 
parable control group d^a wguld be available to establish a comparative 
perspective. These Instruments have all been developed by the evalua- 
tlon staff* Their primary Intended use was for fprmatlve evaluation; 
In som6 cases operational needs were also accomplished through the 
evaluation activities, ^ • ' \ 

1. Employer Cltlster Tests *■ These instruments have b^efh designed - 
; ^ as series of tests of knowledge relevant t9 employer cluster 

learning activities. They were administered as pre-: and post- 
tests for each cluster (academic quarter). These .Instruments 
are currently In the development stag^. Only sample cluster 
Instrumejnts are available, (See Appendix C), 

2, Student Opinion Survey - This tnstr'ument has been developed 
as a corpmon Instrument by the; evaluation staffs of the four 
Experience Based Career Education Programs, It Is designed 
to measure student opinions concerning mc^jor program 

J -activities and objectives. The Instrument has been subjected 

to analysis for refinement purposes. It was administered 
once, at mid-year, TP\e common Instruments will be used both 
summatlvely and formatlvely, (See Appendix C) , ^ 

« » « <» 

3^ Parent Opinion Survey - Thrs Is the parent counterpart to the 
Student Optijlon Survjey; the Information above regarding admin- 
istration and refinement Is pertinent here also, (See Appendix 

0. • ^ - • 
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1». Employer Oplnton Survey - Several- attempts were'rtade to 
design and Inclement an employer^counterpart to the other\^ 
« surveys, but nonp was entirely successful.., 9ata» In this 
. .area have been culled from the att%inpted surveys, Interviews 
and informal sources. Th* background Information section, 
' Is. represented by tliie Experience Resource Site Demographic- 
Data Questionnaire. (See Apple radix C) . 

•» , • , 

5, . Career Exploration Student (juestlonnalre - This Instrument 
has been designed to gather basic student reactions to 
employer learning activities.- jt Is Administered during > 
the last actlvitY session, and results are fedback to the 
employer staff. (See .Appendix C) . 

6%* Forms - Th* generic ter^n Is used to reference a ^a'rly * 
- sdphisticated spt of basic data gathering procedures which 
Kave been developed and implemented by the evaluation staff^ 
This WaTuatTon actlvity'has been de^^^^ Reports 
15A1,«15B1, and 15C1 on Instructional Systems.* These systems 
have .been developed to maximize compater appi Icatlons. The 
forms designed and Implemented Include:^ . . , , 

' a* Student Needs and Interests Form . , 

h. Student Summary Sheets 

• Learning Activities Oes<y^tor Form ^ , 

d* Student Transcript. , 

Student Grade Report 
f..-* Weekly Attendance Report 

" For samples of these forms, see Task Report ISBfl. 



Aretes t-Posttest Procedures * ' , 

Figure I presents the testing schedule employed during FY \S7h.' 

... ' • . ' ' , " * 

It Includes the four suwnative Instruments: CTBS, CMf , ASA and SDQ. 

, • - r-" - , , 

The four student groups comprising the student population are also, 
represented: ^ACE, ACE-Olney, Comparison and Context. For each group . 
on each Instrum^t the pretest point, posttest point and elapsed time 
are Indicated.- As can be seen,' It was not possible to effect an Ideal 
schedule, particularly as a result of schooil requirements for compar- 
ison* subjects and the change In experimental group populations from 

t ■ _■_ _ _ ._i . 

year one to^year two. It was attempted to equate Jntertest Interval's on 

measures where this variable Is . most fmportant. ■> . 

N- • 

A.r' • . <^ " . - 



J: 
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A^A « AflicHSKcnt uf Stmli'iit AttlVtiuKtf Sca1<^ 
)htc 0.iei QufctfAonnalrv- 

2. Group* 



SHQ • Student OvfiOKraphl 



ACC • nih |rtdt Actd«iiy •tud«uts 

ACK • Olnty * 10th md llth grade Acadtny ttudcntu, In cooperative 

frogran with Olncy Mlgli School 
Coaparlaon * llth^gradt; studentn who appUtd to Aciidcay program^ 

wtrt accepted, but optud to {lot enroll 
Context " ta^donly aolccted lOth, llth And 12tU grade Olney Klt'.U 

School atudentii 

3. All pretcate were aihilnlatcred *ln 1973* poatteetsrin 1974. 

4« For each' InAtriuient the colutu\ Indlcatea tlin; In por.the el«pae4 
between prctent and poHtteat. * • « 



For the pretest,- Comparison and Xonte^jt groups were administered ' 
all Instruments In one session* The single tifne period was^ the only 
r«elease*t Ime arrangement possible for Olney students. Since the 
experimental group sessions were fit Into the Academy schedule, two 
periods were required. The ACE .and ACE-Olney students were given the / 
CTBS/CMI In one session and the ASA/SDQ In another* session* , 

Far-the;ppsttest-, the ACE;-studeijts were tested In February fo 

occonnodato vorly graduation'* The" ACE-01 ney group^vas comploted in 
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April. These groups. were.^galn ichWuljsd In two sessions durlngV . 

Academy class time. The ComparUon' aod' Context groups-were agiln 

tested In a single session In June. The composition of Instruments 

^ - , . . . ^ • 

trt session^, was the same for pretest and posttest except for the ^ 

exclusion of the 5^ In the ^i^sttfst. ' <J 

All testing was accomplished by the pr#J^ct evaluation staff 

under standardized' administration pPbcedur^es^ f^retest and post- 

test condUlpni were made as similar as posislbie/or all groups. 

" * ^ ^' ' . ^ ' ^ 

nrterfesTT^^ the degree feasible. For the 

CTBS Level^^ Form (i<,was-used for the pretest and LeveT^ Form R waS 

used'for the posttest. The other tnstruWnts exist ih one form 

only.. ; 

Fl^gures* 2 and } present data on the nurrlbers and.percents of* 
students who' completed the various Instrutnents. Fof tl^ CJBS data 
completeness ranged from' 92% to ]00% for the'»pre*test, 79% to 87% for 
the posttest and ^3% to 79% on complete data pairs. For the CMU 
pretest figures were 88% to 100%^^ posttest figures were^l^l% to ^9%, • 

and complete data pairs were 51% to 79%. for the ASA pfetest complete 

■* 

ness ranged from 68* to' 100*, posttest from 66* to 82*, and fJna,l data 
pairs from 51% to 79%. »For the SDQ returns by-group rangedfrom 66% 

to 75*. ... J^__ 

These percentage rates of return are adequate In all case$'for 
Independent pretest or posttest analyses. The soipetlmcs precipitous 
drop when deriving final data pairs', h<Jwev^r, i^arrants some quest loq 
as to the representativeness of subsequent ^^nalysc-s. The possible 
'ef fleets of this problem ?'n analyses of change mustlbe coni^ldered In 



-^he fnterpretatlon of resuTts. 
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Other : I ns tr'ument Procedures 



r. 



The pretestrposttest Instruments were treated more or lesE as 

a papkagc^ This section discusses Instruments^ that functioned 

* ^ • * V 

^Independently. They were developed fbr use^ the^Career Education 



Pfogram; some were designed specf fleetly, for RBS, while ^others wfere 
constrifcted as comffion Instruments across projects.* EacK wHl be ' 
discussed Individually. ' . 

<^ 

Emp 1 oyer CI us t e r Tes ts . These Instruments were designed for , 

J ' ' . . . • 

three sample? clusters : .Health* Manufa^urlng and Utilities. They 

J ' ' ' 

were administered by Counsebr^Qpordlnators at emplgy.er *sl tes durlfJg 

the Third Quarter. Pretest and posttest administrations were t:on* * 

ducted, but thb sniall numbers of students Involved p reel uded any v 
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sophisticated ^nalyses. Resdurces were not c^v^j^^Lsble to'*pursue 

* # • "^^"^ • - • * 

the* Intended lin^ of deV^lopmerlt/On these Instruments, The common ' 

<»\ » - / ' ^ 

•Instruments assumed' priori ty* ' / . ^ . 

Student Opinldn Survey^ This common Instrument was administered 
by the evaluation staff at mid-year to students fn Academy classes. 

*^ Parent bplnlon Survey > This common' instrument wds admin istcTed 

♦ 

by direct mailing at mid.-yea.r to all parents of Academy- students. 

* Employer Opinion Survey . This common instrument wa's administered 
at mld-ye§ir • through Individual Inte^rviews^ of employer representatives 



by the evaluation staff. 



' Car eer Exploration Student Questionnaire , .This, form was admin-* 

. ^ : ^ r ^ 

Istered by the Counselor-Coordinators during the- last session of- 

♦ * • - * 

each employer course'. \ ^ , 

Forms ., - Th^'^^forrhs system J nvoVves submission of bnsic data on 
learning resources available and student pro9res$ rath qua-rter. These 
constitute the foundation of the computer system/ Explanatioji of tl^e 
nurffeVous procedures involved would be too cumborsbme ror'tno present 

report. For hnore discussion see Task Reports l^Al, 15B1 c^Vid ISCI...^ 

♦ * «. ^ *• > " * / 

. * ' . ^ / • • 

• ' ' ■ ^ 1 • ' ' . 



12 



' " • I > INSTRUMENT LISTING 



]. Student Demographic Data Quest ionnai^re • 



^ *-2* Student Opinion Survey 

,3* Parent Opinion Survey ^. . 

V Experience Resource Site 

Deinographlc Data Questionnaire .... 

5*^ Clust'er Test of Knowledge 

6. Assessment of Student Attitudes* Scale ,^ 

7. Career Exploration Student— QuesjUonnaT^ 

8. Employer *(iuest Ion na I re .......... 



EMC 



1 



V 



CAREER EDUCATION PROGRAM 
RESEARCH FQR BETTER SCHOOLS 
BOOK OF MEASURES 



1. NAME OF INSTRUMENT; Student Demographic Data (JuestionnaJre (SDQ) 

2. RATIdNALE/OBJECTIVES OF INSTRUMENT ; ^Thls form Was designed to 

collect informatton on backgrour^ and demographic characteristics, 
future plans and Basic perceptions of ^school • 

3. RESPONDENT GROUP; The form was designed for any secondary age * 

student Including EBCE expeVlmenta.l s' and controls'^ 

> HISTORY OF THE "DEVELOPMENT OF THE INSTRUMENT: This type of Instru- 
~ ment has been In use. In the EBCE projects since, their Inception. 
It was standardized In format for all of the. projects in FY 7^.' 
It has been revised (see Attachment A) for use In FY 75* 

'5/ ITEM CONTENT ; Includes name, address, telephone number, birth date, 
grade lev/el, sex, race, GPA, absence estimate, parental educa- x 
. tlon and occupation, future caree/ plans, reasons for applying 
to EBCE and school perceptions • I terns. are multiple choice. 

e. ADMI N I STRAT I ON ' PROCEDURES f>/ Amenable to group, 'Individual , or mail 
administration. Time 'for completion Is approxImateVy min- 
. utes. ^The SDQ was "^admlnlstered once during FY 7'l* 



7. SCOR I NG PROCEDURES/SCORl HO^ I NTERPRETAT I ONS ; Individual item scores 
are discrete. Some cespbnse fields are.scalar. ^ Occupational 
Scale order Is 2, 6, 3, 1, 5,^-7, 4 jdlsct^ete 8, 9, 10, 11). 
Occupational and educational , scales combine to form SES estimate 
(Holl Ingshead). Items are used for descriptive purposes and 
demographic Input analyses. • ^ , ' . 



8., RELIABILITY: Not formally determined. 



VALIDITY: Not formally determined. 



ERIC , 



10. DISSEMINATION: Results In group form are provTded to rilE and the 
other EBCE project staffs. ^ . 

15. 
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J1. TECHNICAL DESCRIPHON; The results from the SDQ as administered 

in FY 7^ ai*© found In Attachment B. Analysis has been limited 
to frequency distributions for each project atvd the total. 

^12. RECOMMENDED REVISIONS; The Instrument as appended In Attachment. A 
represents the recommended revisions for FY 7f- 



ERIC 



IB 



ATTACHMENT A 



ERIC 



17 



DATE: 



, CAREER EDUCATION PROGRAM 

Student DesK>grai>hic Data Questionnaire 



NAME: 



ADDRESS :° 



DATE OF B I RTH ^ - RHONE MUMBER: 

Month Day Year— 

School grade level as of September 1974 

1- □ 9th grade ^ / 

2. n 10th grade 

3. □ 11th grade 

4. □ 12th grade 

B» Sex 

1. Q Male— ^1 — ^- 

^2. - □ Female 



C. Race 



1. □ , Black ' , 

2. - " Q White 

3. □ Asian-American (Oriental) 

4. XX Hispanic-American (Spanish Surname) 

5. □ American Indian (Native American) 

6. n Other (specity)' ■ 



\ 



D-/ '^'ml^ch ofxthe following is closest to your lettor gr^de average over the 
^last year in school? ' . < ^ - 

1. Ci F (0.0-0.49) 

2. n (0.5-r.49) 

•3. • 1 C (1.5-2.49) s 

4. ' B (■2.5-3.49)> 

5. 1 A- (3.5-4.00L 4 

•» * 

E. /Which of tiie following best describes your-absense rate over the last 
year in school? 

1. s n absent most of the lime 

2. □ Absent very frequently 
'3.. □ absent sometimes 

4. Q absent- infrequently 

5, □ almost never absent ^ 
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F* What do you expect to b'e doing after completing your secondary school 

program? (check as many as apply.) 

1. □ Full-time employment > " V 

2. C Apprenticeship or on-the-job training program 

3. - □ Regular military service or a service acadeny 

'4.. J'ull-tlme homemaker . , 

5 I O Vocational^ technical , trade or business school « 

6* . □ Study of academic courses at junior or comniunlty college 

7. D Study of technical or: ^vocational subjects at junior or 

community college ' 

8. □ Four-year college or university^ 

9. □ Part-time employment ^ ^ . 

10. n Other (explain) ^^^^--^^ - 

11. □ Don't know - ' ^ ^ 



G. What is the hlgfhest level of formal education completed by your father? 



H. 



I. 



1. 
2. 
3. 

4- 
5. 
6. 
7. 
8. 

9. 

10. 

What 

r. 

2. 
3. 
4. 
5. 
6. 
7., 
8. 

9. " 
10. 

From 



□ Elementary school 

□ Junior High School 

□ Some high school training » * 

□ High school diploma 

' □ ^ome coirege^ralnlng — 

d College degree ^ 

□ Some graduate school training 

□ Graduate school degree 

□ Other (specify) 

D Don't know 

Is the highest level of formal education completed by your^mother? 

C Elementary school ^ 

□ Junior High School 

□ Some high school training ^ . 

□ High school dlplo&a . . , ft 

□ Some college training, 
ColWge degree 

□ Some gradxiate' school training 

□ Graduate school degree 



Other (speclty) 
Don't Anow 
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the following rank the' first (1), second (2) and third (3) most 
Important reasons Why you applied for the Career Education Program 

To receive ''counseling about what to do after I finish school 
To have more^lndlvldual Jdttentlon In my school program 
To find out about careers 

To have learning activities outside of the school « 
To get Into a program different from regular school 
To get help In flxi^lng a job <: ^ 

To make new friends 
To get job training 

Other (explain) • ^ 

' i9 . ' 



1. 


□ 


2. 


□ 


3. 


□ 


4. 




5. 


" □ 


6. 


□ 


7. 


□ 


8. 


□ 


9. 


□ 



J. Do you plan to get a secondary school diploma? 



1. □ Yes 

-2^ -□_.No„ 

3. □ Not 'Sure 



K. IM say school is really worthwhile. 



Strongly 
Disagree 

r 1 



Strongly 
Agree 



4- 



L. I've learned a lot from my school program. 



Strongly 
Disagree 



2 



Strongly 
Agree 

LJ 



FOR THE FOUR QUESTIONS THAT FOLLOW USE ANSWERS FROM THE OCCUPATIQH SCALE 
ON THE .LAST PAGE OF THIS QUESTIONNAIRE , 

M. From the list in the OCCUPATION SCALE which category best describes 
"^^--the work done by your father or male guardian? 



Category Ntpnber^ , % 

If 11. (Other), please^xplain 



U. From the list in the OCCUPATION SCALET wfttch-caJtegory best describes 
the work done by your mother or female guardian?^ 



Category Number " ' 

If 11 (Other) , please explain 



9. From the list in the OCCUPATKW SCALE which best describes the type 
of work you plan to do right after you finish your formal education? 

Category Number 



If 11 (Other) , please explain 



P. From thje list in the OCCUPATION SCALE which category best describes 
the type of work you expect to be doing 5 years after you finish 
your, formal edt^cation? 

Category Number 



If 11 (Other) , please explain 
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OCCOTATION SCALE 

/ . " ■ , V . , . . ■ 

1. CLERICAL AND SALES WORKERS." TECHNliciANS. AND OWNERS OF LITTLE 
BUSINESSES. Examples ; bank teller, business machine operator, u 
sales clerk, draftsman, dental technician., newltand owner, 
tailor shop aowner. secretary, receptionist 

• . * * • - 

2. HIGHER EXECUTIVES, PROPRIETORS OF LARGE (CONCERNS, AND^HAJOR 
PROFESSIONALS. Examples ! bank president, Judge,, executive 
director, city manager, department store owner, Accountant, 
doctor, lawyer, military coninand officer , 

3. ADMINISTRATIVE PERSONNEL, SMALL INDEPENDENT BUSINESS OWNERS, 
AND MINOR PROFESSIONALS; Examples ; insurance agent, store 
manager^ car dealer, tbakery shop owner, gas station owner; 
T)hotographer, mllitaty noh-coramlssioned officer, newspaper 
reporter, travel agent 

4/ "UNSKILLED EMPLOYEES. Examples; cafeteria worker, laundry^ 
. worker, messenger, janitor, unskilled factory worker, farm 
helpers, parking lot attendant, window cleanei:, stock handler 

5. SKILLED MANUAL EMPLOYEES. Examples ; auto Body repairer, car- 
- pentcr, electrician, machinist, painter, pltinber, policeman, 

postman, tailoi:, printer . . 

6. BUSINESS KANAGERS, PROPRIETORS OF MEDIUM SIZED BUSINESS. AND 
LESSER PROFESSIONALS, ' Examples; district manager, police chlej. 
farm manager, postmaster, pales engineer,, clothing store owner, 
real estate broker, theater owner, librarian, military 

commissioned officer, nurse, teacher, pharmacist, musician 

... 

7. MACHINE OPERATORS AND SEMI-SKILLED EMPLOYEES. Examples: 
assembly line worker, bus driver, foundry worker, meat cutter, 
roofer, truck driver, welder, military enlisted person 

■ • * . V • 

8. HOUSEWIFE ' " . ' 

' » . .* ■ ■• 

' UNEMPLOYED 



10. mm 




11. OTHER • 



■7T 
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Analysis of Student Demographic Data Questionnaire 



Note: Data eBXjv^s. represent percentages of the following 

total responses: ■ . • ^ * > " 



TOTAL 

AEL 
FWL 
RBS 




•i 0 



GRADE LEVEL AT* ENTRANCE: 



10th 
11th 
12th 



TOTAL 
17.8 
' 57.6, 
24.6 



NWRF.L . 


AEL 


FWL 


RBS 






30 .'9 • 


23.7 


57.8 


l].l 


.4 a. 6 


76.3 


42.2 


88.9 


25.5 





FATHER ' OCCUPATION . 

- * TOTAL 

Clerical \ . 2.8 

Craftsman 19.1 

Farmer « 

Homemaker 

^Laborer , 14.5 

•Administrator 10.7 

Military , 2.3 

, Operative 16.4 

Professional 15.4 

Proprietor 3.7 
Protective Service • 4.2 

Sales ° , • ^ 

Service 2.8" 

lechinsal ■ 1.4 

- Other .5 

Don ' t Know • 5 , 



NWREL 
2.6 
17.9 



AEL 
2.2 
11.1 



FWL 
2.0 
14.3 



RBS ' 
3.7 
27.2 



17.9 


15.6 


8.2 


16.1 


12.8 


22.2 


10.2 


3.7 


2.6 




4.1, 


2.4 


12.8 > 


24.4 , 


10.2 ; 


J.7.2. 


12.8 


< 17.8 » 


. 22.4 


11.1 


5.1 


. 2.2 H 


10.2 » 








2.0. 


{ 918 
2.4 


12.8 . 




. 10.2 


2.6 


■--5-! \ 


A.r 


3.2 






2.0 


2.4 




■T.I 








2.2 
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» 










It 


MOTHER *S OCCUPATION 




> 






i 


* 


TOTAL 


NWREL • 


AEL- 


• 

FWL " 


RBS 


Clerical ^ / 


17*2 


14.6; 


18.2 


23.6 


15.6 


^ Craf ^snan 


2.0 


* — — — — , 




3.6 


• '2.7' 


Fairinet: 












\ Homemaker 


28. V 


48. R 


38.6 ' 


21.8 ^ 


1^.3 


Laborer 


1.6 


. 2.4 


2.3 • 




1.7 


Administrator 




12.2 


4.5 


7.3 


. 1.7 


Military 


4.8 




— . 




11.1 


Operative 


6.8 


" 4.9'' 


2.3 


'5.5 


. 10.1 


Professionalv.^ 


17.7 


9.8 


22.7 


< 

23s6 


' .15.6 


Proprietor 


1.6 




♦ 

4.5 


1.8 • 


0.9 


Protective Services , 


3.6 


1.4 






.7.4 


Sales 


7.6 




2.3 


5.5 


, 12.1 


Service 


2.0 




4.5 


3'. 6 


0.9 


Technical 


1.2 







3.6 


0.9 


Other 












Don^t Know 







• 









• 

•AVERAGE ABSENCE RATES: 




* 










TOTAL 


NWREL 


AEL' 


FWL 


• *RBS 




12.3 


9.6 


12.3 


N.A. 


13.4 



GRADE POINT AVf-RAGES: 



\ 



TOTAL 
1.99 



NVREL 
2.27 



AEL 
2.00 ■ 



FWL 
N.A. 



o RBS 
1.88 



ERIC 





o 




* 






• 


• 






POST SECONDARY PL/^S': • 
• * 




• 






• 


* 

TOTAL' 




AEL 


FWL " 


Full Time Employroent. 


19.1. 


24.4 * 


'31.1 • 


7.4 . 


Apprenticeship 


7.5 , • 


11.1 ^ 


6.7 


5.6 


MH^tary . 


4.1 


6.7 - 


2.2 


1.9 


Homemaker 


CU5 





2.''2 


. : 


Vocational School' 


. 7.1 


11.1 ~~ 


2,2^ ' 


• 7, -4 


Jr . College-Academic 


■ / 8.6 


8.9 


. 4.4 


13. 'o 


Jr. College^Vocational 


8.§ 







20.4 


Four Year College 


28.3 


jL3.3 


35.6 . 


24.1 . 


Part Time Employment 


6.5 


6.7 


2 2 


11.1 


Other 


.10.0- 


17.8 


13:3 


• 9.3 



JIBS 
16.2 . 
7.3 

6,0 

7.3 

7.3 
♦10.4. 
35.6- 

6.0,.. 

2.9 



FATHER'S EDUCATIONAL LEVEL 



None 

Elementary School 
Some High. School 
High Schodl Graduate 
. Some College 
, College. Craduate 
Some Grad. Work \ 
^ . 4 Advanced Degree 



TOTAL 


NWREL'* 


. 9CeL 


FWI. 


RBS " 


4.2 






2.1 


■ to. 8' ' 


11.1 


30.3 


.9,3 




ro.8 


13.2 




,20.5 


- 8.3 


18.5 ' . 


30.7 


18'. 2 


25.6 


■ 31.3 


. ■ 40.0 


20.1 •. 


30,, 3 


11.6 


29.2 


13.8 


12.7 


2i'.2 ^ 


16.3 . 


n.l ' 


4.6* 


3:7 




9.3. 


6.3. 




4.2 




. 7.0 


8,3 


• T^. 

/ 












/ 






• 





( 



MOTHEk''S EDUCATIONAL LEVEL: 



7 



Nctne ^ ' 

Elementary School • . 
Some High School 
High .School Graduate . 
Som^ College ' \ 
College Graduate < 
Some Graduate Work 
Advanced Degrees, 



REASUN. FOR EBCE ENROLLMENT: . 



TOTAL 


NWREL 


0.5 




6.4 


19.-4 


14. § 






33.3 


21.2 . 


30.6 


12\8 ■» 


16.7 - 


3.9 ■ 





2.0 



: Sifiaia>er» Classes*' ^ 
f ^ . C^pbK, Exploration 
No Ga^g Problem. 

, Choice of .Courjtes 
^ ^ Move^ ^Around C±^ 



Individualized *Inst;:uc- 
tian 

Make* New ^?r lends" 
Other * 



TOTAL 
, 18.3 , 
•47.7 
7.3 
'9.2 

5.5 
2.8 

3.7 1 



, NWREL 



AEL 

4.5 
- 15.9 
40.9 

1^9 

6.8 

• ' 6.6 



AEL 
26.7 
..• 48.9 
17.8 

6.7 

s * 



FWL 
1/8 

12.7 
29.1 
'29.. 1 
18.2 
9.1 
— f- 



FWL 



r ^ 



RBS > 

5.°9 • I 
23.5 
4^.1 
13.2 

8."8 < 

1.5 . 



RBS 

* 12.5. 

♦ 46.9. 

k10,9, 
9.4 

9.4 
■ 4.7 
6.3 



ETHNIC BREAK-DOWN' 
^ SEX 



\ 



Male I 
Female " " 



- TOTAL NWREL 

,,^52.:^'^ ^i:.i 

• : "47.7 ' 48.9 



AEL. 
4'8.9 
51.1. 



• FWL 
47;3 
52.7 



RBS 
59.0 
4f.O 



RACE 



White. 

Black 

Other 



"59.9 
34.4 
5.7 



95.6 



^4.4- 



88.9 
8.9 

2:2 



54.7. 
'28.3 
17.0 



22". 0 
7a. 0 
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CAREER EDUCAlfON PROttRAM 
RESEARCH FOft BETTER SCHOOLS 

• . * <■ 

' . BpOK OF MEASURES 



MAME'OF INSTRUMENT ; Student Opinion Survey (SOS) 

RATIONALt/OBJECT^VES OF INSTRUMENT ; To measure opinions and 

attitudes of EBCE students/ ' * - 

RESPQNDENt GROUP: All EBCE students. 

HISTORY OF THE DEVELOPMENT OF THE INSTRUMENT : This instrument 
was developed as a Joint effort of the evaluation stafx^Tof 
th* EBCE projects and NIE for common use by the projects. It 
was administered once during FY 7k; the results of this 
administration were to be utilized In revision of the 
Instrument for FY 75- -The Instrument as administered In " 
■ FY J^i appears In Attachment A. .: , • 

ITEM CONTENT : ^'^tt I tude toward the program^, benef I ts^^of 'the program, 
attitude toward careers,^ attitude toward program employers, . 
mlscetl laneous. - ' . * 

ADMINISTRATION PROCEDURES : The\inst rumen t was designed fof ,a one- 
time, ajim In 1st rat Ion In all four lab sites. * It was adgilnlstered 
to students in a ^roup format. ^ 

SCORING PROCEDURES/SCORING INTERPRETATIONS^; Most Items on th^s 
instrument are five-point scalar In nature^ Results were . 
^typically presented as response category frequjancles ahd „ - - 
means for Individual Iterris and groups of Itegis,' A mean close . 
to five Indicates a strong positive rating; a mean close to 
one Indicates .a strong negative rating. "An overall Instrument 
^score_ls^not--appropr4ate; sub-scores for Item groups have " 
^■^niot been developed. Attachment C contains a breakdown of means 
*for each EBCE site and the totvil sample. 

REU^UjTY;' Internal Consistency reliability 

KR-20 «^.99 
^ " Split-half reliability ^ ' . 

Spearman -Brown » .78 

It should.be noted that this Instrument was built around two* 
discrete .par^s (to be described Mn the technical section). 
KR-20 .for the first half « .98 ' ' 

KR-20 for j;ie second *half « .99 • ^ : * 

(forrelatlon (biserlal) between Tst half and the total test « -99 
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Correlation (biscrial) between 2nd half and total test « .93 
Inter-part correlation « ♦65 

VALIDITY : Expert validity- The Instrument was ""deve loped by 
^ / In^iptru^'nerit development specialist* The intent of the 

instrument was considered by this group during the inclusion 

of each Item* 

Construct validity- Results of administration of this 
instrument were factor analyzed. Five factor's;, were, extracted 
in order- to coincide with the five scales indicated in *'IT£M'^ 
CONTENT". A varimax rotation of these five factors yielded 
two significant orthogonal factors* These factors are 
essentially: 1) Attitude toward the program, and 2) Why I 
Joined EBCE/Benef Its of the program* 

0^ The factor mSitrIx Is Included In Attachment B, TSble 1. , 

When thcr four factors were rotated, the ''Attitude*' factor 
< separated Into the fIrSt three scales Indicated 'under 
t ^'ITEM CONTENT". More Indepth analysis will be, described 
in the technical description. 

D1SS€MI NATION : Results have been usejd by the EKE program staff 
for Inclusion in Task Reports. 

TECHNICAL DESCRIPTION: This instrument consists of two discrete 
V parts* The first'part contains those items measuring jthe 
first five> scales inclu<fed;in the Item content. The second 
part contains Items relating to the Importance. of potential 
learning activities, and the success of the Project Mn 
accomplishing the delivery of those learning activities. 

l^em intercorrelatlons were computed, and the results charted. 
, These results are included In Attachment B. An examination of 
the correlation pattern reveals several facets of this 
instrument: 1) roughly ten Items In part one intercorrelate 
highly; the remainder do not. 2) ''those same Items correlate 
highly with the "effectiveness" sub--set of part two, '3) 
almost. all Items In the "effectiveness" subset of part two 
Intercorrelate highly, k) there exists almost no correliation 
between the "Importance"' and "Effectiveness" subset of part 
two. 

To further ascertain relationships between parts one and two, a 
factor analysis of the entire Instrument was performed. Two 
factors emerged as significant* The first factor Is entirely 
dominated by part two', the so-called omnibus item. The second 
factor contains those Items from part one whlch^ were soundest 
technically. 

The factor loadings for the two rotated factors are presented 
in Attachmelft B, Table 2. 
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J2. RECOMMENDED REVISIONS! It fs suggested that the number of Items 
devoted to the concept of part two, the "otnnlbus" item, be. 

, ; reduced. In addition, it Is suggested that items 41 and 42 

be deleted'. 



J 



student Opinibn Survey , 

Uiis survey is meant to give you an of^rtunity to ejqpress your opinions 

< 

about the Career Educat:^on Program you have been participating in. Most 
of the questions are to be answered on a scale of niitfcers fixxn(l)to(^ • Uie 
vjords at the top and bottom of eadi set of questiais tell you v*vat the nvitbers 
nean. A© may mean scmethijig like "Definitely No"'; if you feel very strongly 

that the answer to the question i^NO^ then you should circle theQ • .A(5)may 

i. ' . 

nean "Definitely Yes"; if you feel very stroigly that the answer, is YES, then 
you should circle the(D . The nuntoers in between (2^3,4) mean that your 
opinion is. neither "Definitely No" nor "Definitely Yes", but somav*iere between i 
them. You Should circle the nunber that is closest to your real opinion of 
what the question is asking about* Seme scales have different vords, but 
they alw^s work the sarne. Read the words above arri below the nuttoers so 
you loKW^vrfiat the nunbers mean* Bead the ^questions carefully; and circle the 
nutber which is the closest to your opinion* There are no right or wron^ ^ 
answers; your thoughts and feelings are the important things in this^ survey • 
Ihe answers students give will be used to help determine hew well the program 
is (toing now and to iirprove it in the future. Remerrber to circle a nunber to 
answer each item* If you have any questions vrtiile you've oonpleting the sur- 
vey, just ask for assistajioe. 

Because thiVqiiestiomaire is' going to be filled out by students in other 
sd»ols, we hav^\ised the phrase "Career Education Program'' ijn nany questions, 
Ihis really reans^^the Academ/ for Career Education, and you should think of the ' 
•Academ/ v^tien answering the questions. 
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PlEftSE dlCIE ONE NCMEER FOR EftCH QOESTIOW 



1.: 

2. 

/ 

3. 
4.. 
5. 



6. 
7. 

8. 

9. 

10. 

11. 
12. 



Have ycu liked attending the Carets 
Educatlori Progzani? 

If* you had it tD do pver again, do you, 
think you would decide to participate 
in the^Career Education Prograral' 

Have the activities available in the 
Ca r ee r Education Program been interes- 
ting to you?. ; , / 

Ih. .the Career Education Program have 
you felt .that you oould progress at 
your own rate? 

Have you seai much of a relationship 
betWBsen your activities in the learning 
center and the careers you 'have learned 
about? 

Do you get enough feedbadc about how. 
well you are doing in the program? 

Have you had enou^ choice in -deciding 
the amount of tinie you spend at enployer 
sites? ' 

Have you had enough dKdbe in deciding 
the amount of time you spend in learning 
academic subjects? 

Have you had enou^ choice in deciding 
v*iat you do at enplcyer/resource sites? 

Have you haa enough choice in selecting 
the types of eroployer/resouroe sites 
you visit? 

Do most people xeoeive much satisfacticn 
from their vork? 

Do^you think that if a peibon worKs 
hard enough, he can achieve anything? 



Definitel:^' 



12 3 
12 3 



12 3 



12 3 



1 2 - 3 



1 2 3 



12 3 



-1 2. 3 



12 3 



"DefffilbelJ" 



Definite!^ 
Yes 



. 4.1 
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BLEASE.CIRCLE (XfE WKBER FOR EflCH CXJEgTICN " 







j — ^ 




IV^f initelv 
' Yes 


13. 


Do you think that the main reaison a 
person worlcs is to earn en&i^ money 
* to - live? 


1 2 


3 

• * 


— : r . 

4 5 . 


14. 


3h generalr are you lookijig forward to 
working in a job? ^ 


1 2 


3 


4 5 

# * 


15. 


Do you think you have mubh choioe of 
occupations? , 


1 .2 


3 


4 5 


16. 


In general, were the enplcjyer/resouroe . 
personnel involved in the Career 
Bctiicatiqn Program awsore of your needs 
and interests? 


1 0 


O 




17. 


In general, at ennployer/resouroe sites 

did you get to actually do things, 

rather than just listen? - . 


1 2 


. 3 


4 5. 


18. 


In goDeral, have the aiployer/resouroe 
sites you've S^isited been interested e 
in the Career Bduoaticn Program? 


1 2 


3 


4 5 


19. 


In general, have you felt weloone at 
the ^iployer/resouroe sites? J 


1 2 


3 






Do most ..of the eraplqyer/resource sites 
you have worked with let you knw how 
you're progressing? 


1 2 


3 


4\ 5 . . 

\ 


21. 


OJirou^ your eaqperienoes in the Career - 
Education Program have you learned a lot 
Aout opportunities 'fbr the futiare? 




3 


4 5 


22.' 


Do you plan to get a secondary school 
diploma? . . ^ 


1 2 


. 3 


4 ' 5 


23. 


Wbuld you say the Career Education Program 
has helped you form career plans? 


1 2 


3 


4 , 5 


24. 


Nbuld you say you've learned a 16t viiile 
att^f^ding the Career Education Progrann? 


1 2 


3 


4 5 




Definitely 
No 




Definitely 
Yes 
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ELEftSE CIRCLE aC2 NUMBER FOR Eftai QUESTION 



25. Hew well organized and coordinated 
do you think the Career Education 
Program 'has been? } 

26. How would you rate gaieral 
^ quality of the Careei> Education 

Program staff? 

27. ifcw would you rate the personal 
counseling available in the 
Career Education Program? 

28. How would you^rate the careeir 
counseling aveiilable in the Career 
EducatiOTi P^ograiri? 

29. How would you irate the general 
quality of the Career Educaticln 
Program enployer/resouroes you've 

' worked with? 



Poor 



Poor 



Excelleni 



1 2 3 4v 5 



1 2 3 4 5 



1 \2 -3 4 5 



1 2 3 4 5 



,1 2 
-I 



Excellent 



c . 30, 



How iitportarit was each of the follow- 
ing factors in deciding to join the 
Career Education Progratn? 

1 

a. I wanted more freedofT/ind^)endence 

b. I wanted to choose ny own learning 
style ^ 

c. I wanted, to learn about carcxars 

d. I didn't like my previous school ^ 

e. I want^ to prqpare for a job 

f . I Was bored with schobl 

g» I heard the Career Edvicaiton Program 
vas easy 

h. Other (specify) 



I ■ 
Not at all 
Btportant 



1 2 

1 • 2 



\ 
1 
1 



1 
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2 

2 
2 



Not at all 
Iirportant 



3 

f 

3 

\ 

3 
3 



Extrenielj 
IiTporta n< 



4 5 
4 5 

■4 

4" . '.> 

4 5 

4 5 

4 -S 
•* " 

4 5 
h- 



Extrenel) 
Inportant 
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p[£ASE^CIICLE ONE NUffiER FOR mX. QJESnOH 



-33- ^ 

PlBSE CUCLE ONE NCMBER FOR EACH QUESTIGN 



SlJ^ In oonpariaon. with regular schools^, 
hew much opppirtunity did the Career 
BdxjMtion Program provide you fear 
learning about cxxrmpaticns? 

32. In cxqparison with regular schools r 
how mudl opportuniiy did the Career 
Education Prcgtm provide you for 
o^neral learning? 

33. • In aoR(>arisGn vdth past eaqperienoes in 

regular schools, how motivated are you 
to learn in the Career Education Pro- 



Much 
Less 
— h- 



-t- 



Much, 
Less 



About 
the 
Same 
— I — 



Much 
More 
— I— 



+■ 



About 
the 
Sane 



Much 
More 



-.1 



f 



34, During this sdnool year have you woriced outside of hem for money? 

a. □ No 

b. □ Yes, less than 10 hours a week /' 

c. □ Yes, betwfeen 10 and 20 hours a week 

' d. □ Yes, between 20 and 30 hours a week ' . 

e. □ Yes, more than 30 hours a week 
35. ;if you have an outside job, does it interfere with anything listed belcw? 
^. □ I don't have an outside, job . ' 

/ 

b. □ job doesn't interfere with any other activities 

'* , ■ • ' ■ ■ 

c. □ It interferes with ny>chobl work 

d. n It interferes with my social life 

e. Q It interferes with ny extracurriculio' activities 

/ 36. WMit changes; if any, would you like to see in the Career BducaUon Program? 



^5 



Below are listed scte areas of possilsle inportanoe. for a student to l^emii\. 
Please rate each in terms of how important igu feel it is for * student 
to leant* and how well you fqel the program is accomplishing, each. 



Sradents learn to: 



'Perform specific occupational skills * 
Be punctual and organize 'their time . 
Assume responsibility for themselves 



Make decisions and follow through 

■M ■ ■ • 

Commumcate with others^ in a 
ma^ore way 

U Be aware of more career 
opportunities » 

f, . Work with others 

iu Evalute their own work 

Perform basic academifc skills 

J, Think tlitrough and solve problems ' 

k. Have* a poaltlxe- attitude. tQWard_selL. 

■ I, . Have a positive attitude toward >(ork 



^ nu Have a posit^ArelitSSde toward 
learning 

Bu Prepare for further education 

o. Improve interpersonal and social ■ 
• skills 

p» Other (please specify^ ^ 



How Important Po 
Tou Feel This v 
Learning Is? 


JNOC 

Impor- 
tant 


Highly 

Impor-* 

tant 


1 2 


3 4 


6 


1 2 


8 4 


5 


.1 2 


8% 4 


6 


1 2 


8 4 


5 


1 2 


8 4 


5 


• 

1 2 


8. 4 


'6 


1 2 


3 4 


5 


1 2 


3 ' 4 


5 


1 2 


3 4 


0 

\ 


. 1 2 " 


3 4 


6 


1 o 

1 Z 


3 . 4 


5 


1 2 


3 4 

• 


i 


^ 1 2 


3 ~T 


f 


V 2 


3 4 


5 


' I 2^ 


\ 3 4 


S 


1 2 




5 



How Effective Do 1 
Feel the Project H 
Been in Accomplisl 
This Learning?. 



Not Hlgl 

Effec- Eff» 

tlve ttve 

1 "2 8 4 6 

1 2 8 4 5 

1 2 8 4 6 

1 2 8 4 5 

1 2 8 4 J6 

1 2 8.4 5 

12 3 4 5 

1 2 8 4 5 

1 2 8 4 S 

« 

1 . 2 8 4 S 

1 2 3 4 >E 

1 2 8 4 8 

1 -2 — Z A I 

1 2 3 4 ( 

1 2 3 4 ! 

> 

I 2 3 4 1 
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TABLE 1 
FACTOR SCORES 



LOADINGS 



SCALE 



t . 

i"Attitude 
I toward 
I Program" 



"Benefits of 
the Program/ 
Why: I Joined 
EBCE" 



"AttUude , ■.- 
Toward 
Pr'ogram" " 

'^iscellaneous" 



ITEM 

1 
2 
3 

5 
6 

. 7 
8 

9 

10 

II 

12 

13 / 

111. 

15 

16 

■17 ' 
18 
19 
20 
21 
22 
23 
2k 

25 

26 

27 

28 

29 

36 • 

31 

32, 

33 

3k 

35 

36 

37 

38 

39 

ko. 

k\ ' 
k2 



0.7'»'» 
0.710 
0.76'i 
0^697 
0.73'» 
0.673 
0.706 

. 0.759 
0.720 
0.722 
0.609 
0.655 

0.663 

■ 0.677 
0.727 
'0.700 
0.701 
0.712' 
0.637 
0.731 
0.56*1 
0.7'»1 

• 0.732' 
0.733- 
0.777 
0.'696 
.0.767 
0.792 
0.368 
0.^»I9 
0.629 

. 0.2118 
0.579 
0.198 
0.31'».. 
0.153 

- 0.695 
0.63'» 
0.693 



F 2 



0.508 



0.695 

0.699. 

0.6]1| 

0-.657 

0.531 

0.7^»2 

0.369 

O.I'i3 

0.608 



TABLE 2 ^ 



FACTOR LOADINJGS 



ITEM * 


/ - 1 


• 


> 

'0.309 


z . • . 


'0.350 


y- 


' ' 0.336 


k 


' 0.3'»5 


5 


0.316 ' 


6 


• 0.3'»7 




•0.223 




0'.270^ ' 


9 


0.286 


10 


0.259 


11 


• • O.I89 


12 


. 0.271 


13 


« ' 0.18§ 




0.'252 


15 


" 0.2'»8 


16 


0.280 


17 • 


' . . 0.312 ' 


18 ' 


0.3'»0 


19 


0.310 


, 20 « 


" 0.313 


'21 


0.292 


22 


0.266' 


23 


o;2'»o 


2l» 


0.306 


25 


0.230 •. 


26 


o». 290 


.27 


0.262 


28 


: 0.289 


29 


0.31 0. 


30 


0.135 " 


31 ' 




32 


0.257 


^? 


0.097 


•3'» 


0.217 


35 


O.07A 


36 


» 0.098 


37 


-0.002 


38 


^0.312 


39 


p.31'» 




. 0.296 




0.088 




0.175 


' ... 


0.836 



F 2 /- 



.^.8ii7 
0.73l» 
O.813 
0.781 
^ 0,722 

0.61Z 
0.6i»8 
0.670 
0.678 
0.718 
0.65'»' 
0.738 • 
0.521 
0.776 
0.770 
0.709 
. . 0.676.. 

(L769 
ft.80'» • » 

0.575 

0,8li» , 

0.676. 

0.798 

0.817 
'•^ 0:783 V 
N 0.828 . 

0.777 

0".7'»9 

0.829\ 

0,683 

Cl.7'»5 

0.81<3. 

0.578 
" 0.730 . 

0.587 

0.2'»1 
0.858. 
■ 0.759. 
0.808 , 

o.-39b 

O.W 
0.3'»5 



TABLE 2 (Continued) ^.^^.^^^ 
FA'CTOli LOADINGS % . ' 



F 1 - , - . F 2 . 

0.8A7 ■ 0.3A6 

■0.869 '0.3^1 

. 0.855 ' 0.342 

, 0.3J7, ' 

0.876 ' v., -.0.338 ■ 

0,8k7 ■„ .r.,x. 0.332 

.0.826 ' .. o.3l'» . 

Q-.8'»0 ' 0.289- 

0.862 ' . \0,337 ■ 

0.855 ' 0.3*1 

0.8A8, • 0.331 

0.856. * 0.-326 ■ 

0.837"' ' - 0.303 

0.8H • 0.2^2. 

O.hdS 0 0.020 

0.821 . 0.29? 

0.8A1 0\290 

0.i79 o • 0.291 

0.883 : * ■ 0.28^ - 

0.876 ' ' 0.290 

0.905 ^ 0.288- 

0.882 ' . , 0.287 

0.^50 . ' - • 0.2^1 ' 

0.820 0.238 



0.862 ■ 0.267. 

0.861* . 0.265 

0.86A . »» 0.271 

0.€66 0.280 

0.86A 0.272 

0.825 . ' 0.'2A6. 

o.AS'i^'; • 0.017 



40 
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Note: Data entries represent percentages and/or ratings of 
following total responses: 



the 



TOTAL 281 

.NWREL ^3 ■ • . 

FWL 55 
AEL 

' RBS . 139 , 



/ 



/ ■ 



li 




4.2 



-a- . 

Table 1 

Student Opinion Survey Pretest 

, * 
« Opinion of Trofram 



- - ■ ■ ■ ■ . } 

' , Item ♦ 

t ' ' 


Total 


RWREL- 


FWL 


AEL 


KBS. 


* 1. ^ Have you liked attending the Career 
Education ProRram? 


4.28 


4.47 


4.54 


4.55 


3.99 


2. If you had it to do over again » do 
> you think you would decide to par- 
ticipate in the Career Education 
Program? 


4.00 


4,21 


4.46 


4.55 


3.50 


3* Have the activities available in ^ 
the Career Education Program been j 
interestinK to vou? ' 1 


'4.06 


3.^98 


4.oa 


4.2i^ 


4.02 


4* / In the Career Education Program ^ 

have you felt that you could ! ' 
progress. at your own rate?. H 4.33 


4.09 


4.42 


4.36 


4.37 


5* Have you seen nmch of a relation- 
ship between your^ctivities in 
the learning center and the careers 
vou have learned about? 


3.58 1 


3. 61-' 


3.79 


4.01 


3.29 


6. Do you get enough feedback about | 
how well you are doing iti thu • 
propraA? * 3,51 


3.86 


3.58 


3.93 


3.17 


7* Ha>f^ you had enough choice in 
deciding the amount of time 
you spend at employer sites? j 3.47 


3.84 


4.29 


4.16 


2.67 


8. 'Have you had endtigh choice in i \ 
deciding the ainount of time you j 
spend in learning academic; ^ 
sublects? I 3.48 


3.67 


3.87 


4.09 


2.99 . 


9. Have you had enough choice in 

deciding what you do at employer/ ^ 
resource sites? 


3.34 


3.63 


3.79 


3.96 


2.77 


10 Have you had enough choice in " 
selecting the types t)f employer/ 
resource sites you visit? 


3.9i' 


4.05 


4l31 


4.47 


3.49. 


21. Through your experiences in *the s 
Career Education Program have 
you learned a lot about oppor- 
tunities for the future? 


•< 

4.23 




L OA . 




4.26 • 


23. Would. you say the Career Education 
Pr^ogram has helped you'form career 
plans? 


4.14. 




/ 

U 27 




3.89 


24. , Would you say you've learned a. lot 

while attending the Career Education 
Program?*^ 


4.23 


* L AO 

H . HI/ 




A Al 


4.04 


25. How well organized and coordinated ^ 
do you think the Career Education 
« Program has been? 


3.51 . 






•J* i J 


3.34 


*26. How would you rate the general 
quality of the Career Education 
Program staff? 


f 

1 4.04 


4.33 


3.96 


4.23 


3.90 


27. How would you rate the personal 
cdunselfng available in the 
Career E(iucation Program? 


\ 
\ 

{ A. 08 


4.70 


^4.25 


4.35- 


3.65 


28. How would, you rate the cateer 

counseling^^available in the Career 
Education ProKram? 


I 

« 

1 3.87 


4.12 


3.81 


4:21 


3.68 


29. How would you rate the general 

. . quality of the Career Education i 
Program employer/resources you've 
worked' with? 3.82 


3.79 


3.83 


4.05 


3-. 75 


Averages " 3*88 


4.05 


4.06 


4.23 


3.60 



ERIC 



*Table 2 . ' 
Student Opinion Survey Pretest 
Opinions of £;mployer/Resources 



> 

Item " 


Total 




FWL ' 


AEL 


RBS - 


16 • In general 9 were the employer/ 
resource personnel Involved in 
the Career Education Prograi^ 
aware of your needs and 
interests 


3.51 


3.74 


3.58 


3.64 


3.35 


17. In general, at employer/ 

resource sites did you get 
to aql^ually do things, rather 
than iust listen? ' * 


3.70 


4.28 


3.65 


4,39 


3.23 


1&4 In general, have the eraployef/ 
resource sites you*ve visited 
been interested in the Career 
Education Program? 


3.92 


1 

4.00 


4.00 


4.14 


3.76 , 


19. In^^-g^neral , have* you felt 
welcomfe'^-at the employer/ 
resource sites? 


4.13 


4.00 


4_35 — 


■4.-30 


-4_00 


20. Do most of the employer/ 
resource sites you have 
worked with let you know how 
you*re progressing? v 


2.91 


3.44 


0 

3.08 


3.09 


2.55 


' Averages 


3.63 


3.89 


3.73 


3.91 


3.38 



Means on scale from 1 = ibv^to 5 - high 



Table 3 , ^ 

Student Opinion Survey. Pretest- 
Opinion Comparative to Traditional Schools 



Item 


Total 


NWREL 


FWL 

t 


AEL 


RBS 


31. In comparison with regular schools ^ 
how much opportunity did the Career 
Education Program provide you for 
learning about occupations? ^ 


4.67 


4". 79 ' 


V 

4.77 


4.84 


4.50 


32. In comparison with regular schools, 
how much opportunity did the Career 
. Education- Program^ provide you for 
general learning? 


» <*• 
3.87 


'4.00 


3.^9 


3.7i 


3.97 


33. In 'comparison with past experiences 
^ in regular schools, how motivated 
are you to le^rn in the Career Ed- 
ucation, Program? <= 


4.22 


4.47 


4.44 


' — m 

4*30, 


3.99' 


Averages 


4.25 


' 4.42 


4.30 ' 


4.2« 


4.15 



Means ,on scale from l«low to !)»hlgn 




^ Table 4 
Student Opinion Survey Pretest 

o 

Vocational Attitudes 



^ Item 


Total 




FWL 


AUL . 

a 


RBS 


11. Do most people receive much 
satisfaction from their work? 






>.39 


3.77 


' 3.58 * 


12^. Do you think that if a person 

works hard enough^ he can achieve 
anthing? 


4.39 


4.40 


4.17 


4.25 


4.41 


13* Do you think that the main reason 
a person works is to earn enough 
money to live? 


3.38 


3.72 


3.17 


3.30 


3.39 


14 • In general, are yo^i looking for- 
ward to working In a job? 


4.29 


3.84 


4.21 


4.30 


4.50 


15. Do you think you have much choice 
of occupations? 


4.15 


3.98 


4.27 


4.19 


4.15 


Averages 


3.96 


* 

3.92 


3.84 


3.96 


4.01 



Means on scale from l«low to 5«high 
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Table s 



Student Opinion Suxivey Pretest 
Omnibus Question 



Item: Below are listed some areas of possible importance for a student to learn. 
Please rate each in terms of how important you feel it is for a student 
to liearn, and hpw well you feel the program is accomplishing .each:. 



Ivq>ortance 



Effectiveness 



Subparts 



Total 



NWREL 



FWL 



A£L 

"T 



RBS 



TOTAL 



NWREL 



FWL 



Students learn to°: , 

a. Per<'form specific 
occupational" skills 



4.24 



3.87 



4.64 



4.18 



3.83 



4". 10 



b. Be punctual and 

oi;gani2e their time 



4.-35 



4.40 



4.40 



4.34 



4.31 



3.83 



4.02 



3.96 



Assume responslbi- 
lity for themselves 



4.63 



4.58 



4.81 



4.66 



4.53 



4.19 



4.24 



4.35 



d. Make decisions and 
follow through 



4.51 



4.65 



4.51 



4.71 



4.33 B4.U 



4.20 



4.22 



Communicate with 
others in a mature 
way 



4.51 



4.49 



4.40 



4.59 



4.54 



4.01 



4.19 



4.09 



f . Be aware of more 
career opportuni- 
ties 



4.42 



4.53 



4i73 



4.53 



4.45 



4.48 



4.50 



..g. Work with others 



4.44 



4.77 



4.17 



4.57 



4.35 



4.24 



4737 



4.09 



h. Evaluate their" 
own work 



4.07.- 



3.95 



4.04 



4.43 



3.94 



3.86 



3.91 



3.74 



1. Perform basic \ 
academic skills 



4.11 



4.07 



3.98 



4.18 



4.18 



3.84 



4.12 



3.39 



-Think through and 
solvie prob iems 



4.49 



4.45 



4.55 



4.59 



4.42 



3.97 



4.14 



4.09 



k. ,..Have a positive 
' attitude toward 
self 



4.53 



4.51 



4.35 



'4.77 



4.51 



3.97 



/ 
4.07 



3.78 



1. Have a positive 
attitude toward' 
work ' 



4.48 



4.33 



4.65 



4.66 



4.37 



•J. 94 • 



4.00 



3.98 



m. 



Have a positive 
attitude toward 
arning 



Tr 



4.56 



4.52? 



4.49 



4.58 



4.62 



4.12 



4.21 



4.22 



repare for further 
education 



4.19 



3.71 



4.48 



4.25 



4.24 



3.96 



3.91 



4.02 



Improve interper- 
sonal and 'social 
* skills ■ . 



4.22 



4.15 



4.32 



4.52 



4.05 



3.92 



'4.07 



4.02 



Other (please 
specify) 



4.31 



4.33 



5^00 



4.25 



4.17 



4.00 



f.OO 



4.50 



Averages 



4.39 



4.35 



4.41 



4.53 



4.33 



4.02 



4.13 4.04 



Table 6 

Student- Opinion Survey Pretest 
Reasons for Entering the Career' Education Program 



Item 


Total 


NWREL 


FWL'' 


AEL 


RBS 


30* How Important was each of the 
following factors. In deciding 
to join the Career Education 
Program? ■ 

a« I wanted more freedom/ ^ , ^ 
Independence 


3.79 


f 

4.02' 


4.02^ 


3.96 


3.52 


b* I wanted tp choose my own 
learning style ' ^ 


4.03 


4.07 


4.42 


4.14 


■3.79 


c* I wanted to .learn about 
* careers / • 


4.37 


4.47 


4.33 


4.52 


> 

4.29 


I didn't like my previous 
school 


3.34 


3.7.2 


3.7J 


3.2j« 


•3.13 


e. I wanted to prepare for a 
job 


4.07 


4.21 


3.58 


4.34 


4.13 


' f . I was bored with school 


3.40 


4.00 


4 ".00 


3.43 


2.87 


g. I heard the Career Ed- • 
ucatlon Program was easy 


2.12 


2.02 


2.06 


.2.44 


2.05 


h. Other (specify) 


4.34 


4.55. 


4.62" 


4.80 


3.90 


Averages 


■» 

3.68 


3.88 


3.84 


3.86 


3.46 



Mean^ on scale from 1 =« low 



■ 4?; 
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^ Table 1 . 
Student Opinion Survey Pretest 
Othlir I tens . 



Do you plan to get a secondary school diploma? 



Response 


Total 


Nwm . 


FWL 


AEL 


UBS 


1. Definitely No 


14 


...J, ,. 






' 9 


2 • ,\ 


9 


4 






5 


3. 


41 


13 




3 


23 


4. ^ ■ 


■ ■ 29 ■ 


■ 5 


' 1 




25 


5. Definitely Yes 


154 


15 


51 


41 


.47 


Average 


. 4.22 


3.50 - 


4.98 


4.86 


3>86 



During this school year have you worked outside of home^ ?or money? 



Response * 


Tdtal 


NVREL 




AEL 


RBS 


1. No. 


48.0 


18.6 


46.2 


42.9 


"62.2- 


2. Yes, less than 10 hours 
. a week 


14.1. 


23.3 


19.2 


16.7 


7.2 . 


3. .Yes, between 10 and 20 
howrs a week 


21.0 


32.6 


21.2 


2^.2 


14.4 


4. Yes, between 20 atid 30 
hours ^week \ 


6.5 


9.3 


9.6 


2.4 . 


5.4 


5. Yes, more than '30 hours 
a week ' 


10.4 


16.3 . 


3.8 


ll\9 


It). 8 



If you have outside job » 



^ Response 


Total 


MWREL 


. FWL 


AEL 


RBS - 


1. I don't have an outside 

^ iob 


55.1 


39.0 


h 

50.0 


54.4 


65.9 


2. job doesn't' Interfere 
with any other activi- 
ties 


28.7 


36.6 


t 

38.5 


28.6 


19.3 


3^ It Interferes with my 
school. work 


5.1 


9.8 


. 7.7 


2.8 


• 2.3 


4. ' It Interferes with my^ ^ 
social life ^ 


8.3 


14.6 


3.8 


11.4 


6.8 


5, It Interfered with my 
extra curricular fctl- 
vities 


2.8 


< 

0.0 


'0.0 


2.8 


5.7 ' 



CAREER EDUCATION PROGRAM . • ' . 

RESEARCH FOR BETTER SCHOOLS 

ROOK OF MEASURES , 

> ■ . ; • ■ . 

NAME OF INSTRUM ENT; Parent Opinton slxrvey (P0$) • 

' — — ' — J . c 

RATIONALE/OBJECTIVES OF INSTRUMENT: To measure opinlons^ apd 
~ attitudes of Parents of EBCE students. \ • 

RESPO NDENT GROUP: Parent3 of EBCE students. - ^ 

HISTORY OF DEVELOPMENT : This instrunicnt was developed as a joiotf* 
effort of the evaluation staffs of the EBCE projects and*NIE ^ 
• for common use by the projects. It was. admin isteVed once 
during FY 7^; the results of this administration were to bje 
utilized |n revision of t^he instrument for FY 75-* * The 
instrument as administered in FY 7^ is included in Attachment A 

ITEM CONTENT ; Attitude toward the projgram, benefits of the prog r^am 
interaction with the program, ratings of staff. 

ADM I N i STRAT I ON PROCEDURES : The Instrument was designe'd'/fpr d one- 
time acimlnistration In all four lab'sitesV Parent Opinion- 
/ Surv'igys have been mailed out with a pre-paid return envelope, 

SCORING PROCEDURES/mTERPRETATIONS : Most Item^ on thi? instrument 
are five*-po!nt scalar in nature., Itesul^ts were typically 
presented as response category frequencies and means for 
individual litems, and groups of items. A mean close t9. five 
indicates' a strong positive ratings a mean close to one • 
indicates a strong negative rating. An overall Instrument' 
score is not appropriate; sub-scores for item groups have 
not ieen developed. Attachment C contains a breakdown of 
means for each EBCE site and the total sample. 

RELIABILITY ; Internalnconsistency Rel iabi 1 ity: 

K-20 = .93 . ' ' • •' ' 

SpUt-Half Reliability: 

Spearman- Bro,wn = .55 , 

It should Be^noted that this instrument was built around two 
discrete parts (to be described in the technical description). 
KR-2b for the first half » .81 " . ' • 

KR-2b for the second half « .95 . 

Correlation (Blserlal) between 1st half andi total test » .67. 
Correlation (Biserial) between 2nd half and total te§t = .94 , 
Inter-part correlation • . 38 . ^ 



AS 



9. VAUDITY; Expert validity The instrument was developed by 
instrument development specialists* The' intent 
of the instrument was considered by this group 
during the inclusion of each vitem. 

. ' Construct validity-- .Results of administration 

of this instrument were factor analyzed. Five 
factors were extracted, in order to coincide 
with the five scales indicated in 'Mtem Content." 

'A yarimax rotation of those five factors yielded two significant 
orthogonal factors. These factors are essentially 1) 'attitude 
toward the program, and 2) ratings of staff. 



The factor matrix 


is included 


below. 


• 




TABLE I ■ 


— Factor Scores 




SCALE 


• ITEM 


F 1 


F 2 


**Attitude toward 


1 


.' .76 




Prog raff!** 


2 


.02 






3 


.69 


— \ 




6 


.33 




"Benefits 


' ■ 7 


' ■ • , .65 




of 


8 


. .57 . 




the 


9 


.57 




Program" 


10 


i.52 




"Interaction 


II 




« 




.3^5 




with 


15 




.35 


Program" ' 


/ 16 




.36 


"Ratings 


. 17 




.59 


of . , • 


18 






Staff" • 


19- 




.79 




' 20 




■ .82 


"Miscellaneous" 


♦ 21 








22 * 







4 • • » 

The initial constructs used during developmefvf have fairly well 
been borne out byithe factor analysis. More in-depth analysis' 
will be des1:ribecl in the tcchnica^ description* 

10. DISSEMINATION : Results have been used by EBCE program' staff 
for inclusion in Task Reports. 



■ ■ ■ . ■ \ ^ . ' 

. . 

TECHNICAL DESCRIPTION; This Instrument consists of two -discrete 
parts. The first part contains those Items measuring the 
five scales Included In the }ten\ content." The second part' 
contains Items relating to the Importance of potential 
. learning activities, and the success of the project In 
accomplishing the dellyery of those learnlna activities. 

^ Item Intercorrelatlons were computed, and the results charted* 
These results are Included in Att;achment An examination 
i-of the correlation pattern reveals several facets of the 
Instrument: 1) seven Items In part one Intercorrfelate highly; 
the remainder do not- 2) those same seven items correlate 
fairly well with the ^'effectiveness" sub-set of part two, 3) 
almost all Items In the "effect Ivenesjs'^ sub-set of part' two 
Incorrelate very highly, k) there exists almost no correlation 
between the "ImpoVtance" And "JEf fectlveness" subsets of 
part two- ^»r..- 

* To further ascertain relatlonshIps\bettween parts *one and two,, 
a factor analysis o^ the entire instrument was performed. Two 
factors emerged as significant* The first factor Is entirely 
dominated by part two, the so**cal]ed omnibus item. The second 
,f actor contains those items from part one which were soundest 
technically, as well as the effectiveness items from part two* 

Table 1, Attachment B, lists factor loadings for\the two' 
rotated factors^. 

\ ■ ■ 

RECOMMENDED REVISIONS ; It Is suggested that the number of. items 
\ devoted to the ^concept of part two, the "omn'fbus" Item,' be 
.Reduced. In addition, it is suggested that Items 21 and 22 be 
sleted. 

f 




ATTACHMENT A 



/ 



f. 



ERIC 
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. ' Parent Opinion Survey 

■ . - / . 

This survey Is iseant to give you an opportunity to 'express your opinions 
about the Career Education Program your son or daughter has buen participating 
ln« Host of tha-qi^stlona are to bS answered oh a scale o£ numbers from (D to 
©• -Ihe phrases at the irop and bottom of ^ac^'^t of questions Indicate what 
the icale means* AQmay mean something like ^'Definitely No"; If you f^el 
strongly that the answer to the question Is No, then you should circle the(^ 
^^(S)may mean "D^'finltely Yes"; If. you feel strongly that the answer '^Is' Yes > 

then you should circle the^Q). The numbers In .between (2,3^4) • Indicate "hn 

^- ^ ' ' • ' - 

opinio somewhere ln--between "Definitely No" and "Definitely Yes"* • Some scales 

have different phrases^ bu^t they all work^the same way. 

. Read the phrase above and belpw the numbers so you know what the scale 

means» then read each question » and circle the number which Is closest to 

your opinion* There are no right or wrong answers> yoVir thoughts and feelings 

are the Important things* in this survey. The answers ^fl^rents gi,ve will help 

determine how Veil the program Is doing now and Improve It In the future* 

Remember t9 circle a number for each Item^ Thank yo^ f or taking the -.time to 

fill out this survey* Individual results will be kept confidential/ 
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Career Education Program 
Parent ppiniat Survey 



How well does? the Career Education Program .ocin>are ov^all with tMe past 
school experiences pf your da\jighter or son? 



Much 
Wbrse. 



\3 ^ 



' 1 

Mudi 
Better 



If you had it bo do oyer again^ waild you v^ant your scai or daughter to partici- 
pate in the C^6er Education Ptograttj? ^' ^ . ^ 



Definitely 
NO 



Dgrarft? 



Definitely 



ifew vrell 66 you think ^yBur son or daughter likes the Care^ Education Program' 
cotpared .with past school e)q)eriences? * ^ 



Much 
Worse 



' Much 
Better 



What dp you think "are trie greatest weaknesses of th^ Career Education Program?* 



/ 



Vvhat do you think ^^Ltre| the greatest streng^is of the Career "^Bducatipn Program? " 



6. 



Have you reoeiv^ enoughs inf ornatid 
ih'the Career Bduoatiot Progfran? 



Definitely 



about your, SOI or daiai^ter's progress 



Definitely 
YES 



"I 



7. 



In ccn|>arison vdth regular schools how moch ojpportunity did ^tihe Career 
Education Program provide your (daughter ot^son for learning about ooccpations? 



Much 
Less 



About- 
Sane 



Moch 
More 



. 8. 



What effect, if any, has the Career Ectucatiori PtSgram had on hejpin^ ycxir son 
*ar daughter form^'ccureer plans? ' .! 



Definitely 
Bad 



No 
Effect 



l!)efinitely 
. \ Good 



5 . 



In ocwoarison with regular scixxols hew itach oppurtunitv did the Career 
Education Program ^provide your daug^iter or son for general learning? 
s ^ . 

Much ^ About the Much - 

Less , Same / More^ ^ ^/ 



10 • In oortparison v^ith past experiences in regular schools hew motivated is your 
^ , davi^ter or son to learn in the Career Education Program? . 



Much 
Less 



About the 
Same ^ 



Much 
1tore 



11. How v^uld you rate the approaches to learning used in the Career Education 
Program? ' 



Poor 



Excellent 



r 
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12/ What positive chang^ have you notice^ in your Son or daxighter that might be 
a result of participation in the Career Education Program? 



f^f' — : : ] 

13/*' What' negative cl;ianges have? you noticed in your daxjghter that might be a 
result of participation in the Career Education Program? 



14. How oftfen does your son car daxighter talk to you about vAiat's going on" in the 

Career Bduca.tion Program? ' , , . / 



/Alitiost 
/.Never 



^ 2 



Almost 
D^ily 

■'5- ■ 



15'. About hoj^ often have you had any contact with any Career Education Program 
staff mertbers? 



Almost 
Never * 



; Very 
Presently 



\ 



16. Hoi/ many meetings have you attended during this school year vAxere other 
^ narentp o£. Career Education Students were present? 




/None 



^ 2 



4 or ^fc)re 



' 17. / How v^uld /you rate the general quality of the Caiieer EducatoCTi Progran staff? 



» Excellent 



X ERIC 
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18. flow vrojild you rate business and cccmmity resources ayailgM^e in the 
Career Bducaticai Program? 



^^r 
1 



Excellent 

5 . 



19. Hcw' would you rate your overall relatiqiship with the staff of the Career 
, Bdiicatiofi Program? , 



?oor 

a 



Excellent 
5 



20. How wuld you rate the ejitJhusiasam of the Career Education iProgranv staff ? 
Poor • . Excellent 



21. What do you think of, the occi5>ational plans of your daughter or son? 

a. ri There aren't any ^"ixm plans yet. • 

b. LJ The plans should be ichanged. 

- ' c. * []]] .^^^ plans seem to be good. ^ 

d. Q We haven't really had a chance to- discuss the plans. 

22. What do you think your son or daughter will be doing a year after high school? 

a. . Q] Wbrking . ' 

b. Q . At^tending same kind of college 
x:. n Going to a business or , trade 

d. □ Military 

e. Q Other (please specify) 




ERIC ^ 
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23. Below are listed acne areas of possible IxriJortancse for a stulent to learn. 
Please rate e^ch in terms of how important jrou feel it is for a student 
to leam» and how well you feel thel program is accomplishing each. 



Students learn to: 

a. Perform specific occupational skills 
^ b. Be punctual and organize their time 

c. Assume responsibility for themselves 

d. Make decisions and follow through 

e« Communicate with others in a 
mature way 

L Be aware of more career / 
opportunities 

g. Work with others 

h. Evalute their own work 

L \ Perform basic academic skills 
j. Think through and solve problems 
k« N Have a positive attitude toward self 

. • I 

1. Ekve a positive attitude toward work 

f ' -0 

.m. Have a positive attitude toward 
learning ^ 

n. Prepare for further education 

o. Improve interpersonal and social 
. skills 

p. Other '(pleasi! > specify) 



Bow Important <Do 
You Feel This 
Learning Is? 



Not 

Impor- 
tant 



Highly 
Impor- 
tant 



^345 
2 3 4 5 



2 3 4 ^ 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 



How Effective Do 1 
Feel the Project H 
^een in Accompliis] 
This Learning? 



Not 
Effec- 
tive 

2 



2 3 4 5 
2 3 4 5 



2 3 4 5 

2.3 4 ' 5 
2 3 4 5 



2 
2 
2 
2 



3 4 5 

3 4 5 

3 4 5 

3 4 5 



2 3 4 



.2 3 4 



^2 3 4 



2 3 4 9 
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24. Hew did you first hear about the Career Education Program? 



' 25. What kind of students do you think benefit itost fron Career Education- 
Programs? ' 

0* .. 



ERIC 
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TABLE 1 
Factor Loadings P.O.S. 



SCALE 



!TEM 



F I 



F'2 



Attitude 
Toward 
Program 



Benefits 
of 
the 

Program 



Ratings 
of 
Staff 



Omnibus 
I tem 



Importance 
i terns 



Effectiveness 
t terns 



I 
2 
3 
6 
7 
8 
9 
10 

n 

\k 
15 
16 
17 
18 
19 
20 
21 
22 
23 
'2k 
25 
26 

27 
28 
.29 
30 
31 
32 
33 
34 
35 
36 

37 
•38 
39 

'to 

k\ 
k2 
^3 
kk 
kS 
46 

47 
48 

49 
50 
51 
52 
53 
54 



-0.070 

-0.135 

-0.136 
0.119 

-0.046 
0.041 
0.021 

-0.018 
0.007 

-0.001 
0.127 

-0.040 
0.081 

-6. 101 . 

-0.071 

-0.039 
0.120 
0.055 
0.447 
0.764 
0.903- 
0.815 
0.812 
0.703' 
0.755 
0.682 
0.388 

0.89^ 

0.674 

0.556 

0.670 

0.673 

0.723 

0.276 

0.411 

0.530 

0.565 

0.557 

0.506 

0.533 

0.499 

0.500 

0.480 

0.494 

0.516 

0.505 

0.532 

0.512 

0.516- 

0.281 



0.65^ 
0.605 
0.595 
0.336 
0.589 
0.539 
0.582 
0.546 
0.638 
0.279 
0.107 
0.097 
0.400 
0.352 
0.319 
.230^ 
.259 
.079 
148 



0. 
0. 
0. 
0. 



f>1 



-0.099 
'-0.059 
-0/154 
-0.079 
-0.009 
~0.04l 
0.093 
0.118 
-0.052 
0.022 
.0.010 
0.068 
-0.054 
. 0.002 
0.V67 
0.486 
0.591 
0.553 
0.615 
0.609 
0.575 
0.644 
0.587 
■0.626 
0.666 
. 0.622. 
0.-709 
0:681 
0.697 
0.647 i 
0.236 




Mote: Data entries represent percentages and/or ratings of the ' 
following total responses* 



Total 


159 


NWREL 


28. 


FWL 


3« 


AEL 


30 


RBS 


, 67 





Table 1 
Parent Opinion Survey 
Attitude Toward the Progr«n In General 



Items 


Total 


NWBEL 


FWL 


AEL 


RBS 


1. How well does the Career Education 
Program , compare overall with the 
past school experiences of yoi^r 
daughter/son? 


4.40 


V 

4.37 


4.23 


4.43 


4.47 


2. If you had it to da over again, 
would you want your son/daughter 
to 'participate in the Career 
Education Program? 


4.54 


u 

4.67 


4.41 


4.77 


4.43 


3. How., well do you think your son 
or daughter likes the Career 
Education Progtam compared with 
past school experiences? 


4.68 


/ 

4.63 


4.79 


4.80 


4.58 


Averages 


4.54 


4.56 


4.48 j 


4.67 


4.49 



Table 2 ' 
. Parent Opinion Survey 

Interaction With Projjr am . 



n ^ . 

X Items 


Total 


NWttEL 


FWL 


AEL 




14 • How often does your son* or 
daughter talk to you about 
^t's going on in the 
Career Education Program? 


/ 

4.02 


3.79 


3.82 


4.40 


4.05 \ 


^5. About how often have ydu 
had any contact with any 
Carreer Education Program 
. Staff Members? 


2.63 


2.69- 


t 

2.47 


2.47 


. ,1 
2.77 


Average 


3.33 




3.15 


3.44 


3.41 








Aver a 


• 

te # 


Items 


Total 


NWREL 


FWL 


.AEL 


RBS 


16. How mahy meetings have you 
attended during ttnis school 
•year where other parents of 
Career Education Students 
were present? , 


0.93 


1.50 


"V 

0.68 


0.93 


• 0.81 
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Table 3 
Parent Opinion Survey 
Benefits of the Program 



Items 

■ • *' _ 


Total 


NWREL 


FHL 


AEL 


RBS 


6e Have you received' enough Inforwitlon 
about* your son or daughter** progress 
In thi Career Educatloii Program? 


3.79 


4.11 


2.71 


4.23 


4.00 


7e In coiiq>arl8on with regular schools 
how much opportunity did the Career 
Education Program provide your 
daughter or son for learning about 
occupations? 


4.76 


4.74 


4.77 


4.77 


4.76 


8e What effect » If any » has the Career 
Education Program had on helping 
your son or daughter form career ' 
plans? 


4.31 


4.31 


4.24 


4.17 \ 


4.41 . 


9. In comparison with regular schools 
how much opportunity did the Career 
Education Program provide your son 
or daughter for General Learning? 


4.25 


0 

4.41 


3.71 


4.07 


4; 5 3 


10. In co]q>arl80n %rlth past experiences 
in regular schools how motivated is 
your daughter or son to learn in 
the Career Education Program? 


4.50 


4.48 


4.62 


4.40 


4.49 \ 


11. Hoy votild you rate the approaches 
to learning used in this Career 
Edxicat ion Program? 


4.39 


4.44 


4.27 


4.30 


\ 

4.45 


, Average 


4.33 


4.42 


4.39 


4.32 


4.44 



Table /» 
Parent Opinion Survey 

Opinion of Staff 



Items ^ 


Total 


NWREL 


FWL 




Due 


17. How would you ratjB the general 
A^allty of the Carter Education 
rrosram Staff? i 


4.36 


4.48 


3.96 


4.42 


IvDO 

4.46 


18. How would you rate business and 
community resources available in ^ 
the Career Education Program? 


4.29 


4 .69 


L M 

H . A / 




• 

4.24 


IH. How would you rate ;your overall 
relationship with the Staff of 
the Career Education Program? 


3.85 


4.23 


3.93 


'3.56 


3.77 


20. How would you rate the enthusiasm 
of the Career Education Program 
Staff? 


4.47 


4.84 


4.35 


4.35 


4.44 


Averages 

T" " — » 1, 


4.24/ 


4.56 


4.10 


4.12 


4.23 



! Table 5 

Parent Opinion Survey 

1 Miscellaneous 



i ' ' ' 

21, What tlo you think, of | the occupational plans of your son or daughter? 



. Response' i * / 




Total 


ssponset 
NWREL 


3 

FWL 


AEL 


RBS 


A. mere aren't any firm plans yet. 

B. The plans should be chaAged. 

C. ^ The plans seem to be good. 

D. We haven't really, had a* chance 
to discuss the plat\jB. 


49.7. • 

1^9 
43.9 

4.5 


63.0 
3.7 

29.6 
3.7 


58.8 " 
2.9 
32.4 

'\ 


56.7 
0.0 

40.0 
3.3 ' 


35.9 
1.6 

51.8 
4.7 



22., What do you think your son or daughter will be doing a yeaXfter 
High Schpol? ^ .1 / / ' . ^ 

% of Responses 



Response 


Total 


NWREL 


FWL 


AEL 


RBS 


A. Working ^ 

B. Attending some kind of college 

C. Going to a business or trade 
school 

♦D. Military ^ 
-^E* ' Other 


26.0 
43.8 
15.8 

8,2 
6.2 


37.0 
25.9 ' 
25.9 

ll!l 
0»0 


12.5 
. 71.9 
. 6.3 ' 

6.3 
3.1 


11.1 
40.7" 

iia. 

•29.6 


34.9 
"38.3 
18.4 

0.0 








■ ( 
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T«bl«'6 

J'afent Opinion Sutvt'y 



23. Below are listed sons areas of possible Importance for a student to leatn. 
Please rate each In tens of how Important jrou feel It Is for a student to 
learn » and how well you feel the pYograa Is accoapllshlng each*' ' 



livortant. Bffactlv* 


ii^ Students learn £o: 


Total 




'FWL 


AEL 


SBS 


Total 


mntEL 


FHL 


r 

HEL 


! ^ 


l^^a* Per form specific occupa*^ 
ir^i tlonal skills 


4.46 


4.50 


K 

4.00 




4.80 


3.96 


4.15 


3.75 


4.00 


3.97i 


|r;b.^ Be punctual and ^ organise 
^ their tinie. • 


4.84 


• 

A. 86 


4.85 


4.7e 


4.89 


4.01 


3.82 


3.82 


3.97 


4.21 - 


IK^'c^.^.AaeuM responslb^Ulty 
]fe for; theasielves 


4.93 


4.93 


4.97 


4.93 


4.94 


4.40 


4.04 


4.47 


4.38 


■f ^. 
4^52 


Ma. .iiaicexdeclalons ana 
follow thrbu A 


4.84 ' 


4%89 


4.97 


4.a3 


4<,80° 


4.14 


>.96. 


4.15 


4.17 


i.21 ^ 


flVe; .CoMunlcate with others 
In a MtureVaT ^ 


4.89 


4.82 


4.82 


4.90 


4.95 


4.39 


4.33 


4.29 


4.38 


4.48 


f . Be, aware of aore career 
l}^ opportunities 


4.69 


4.64 


4.47 


4:62 


4;80 


4.51 


4.56 


4.41 


4.38 


4.60 


Work with others 


4.79 


4.86 


4.68 


4.79 


4^83 


4.42 


4.37 


4.12 


4.64 


4.5a 


ii^^h. Evaluate their own work 


4.62 


4.50 


4.61 


4.66 


4.^7 


4.01 


3.96 


4.15 


3.86 


4.03 


f 1. ^ Perform basic academic 
i^; skills 


4.67 


4^61 


4^67 


4.62 


4.72 


3.90 


3.89 


3.44 


4.15 


4.03 


f J. Think through and 8o].ve 
problems 


4.85 . 


4.86 


4.88 


4,83 


4.86 


4.10 


4.04 


4.^ 


4.07 


4.07 


r k. Have a positive attitude 
it^ toward aalf 


"4.87 


4.75 


4.91 


4.82 


4.97 


4.36 


■ 4.15 


4.47 


4.37 


4.39 


1^ 1. Have a positive attitude 
^ toward work 


4.84- 


4.86 


4.82 


4.79 


4.^6 


4.21 


4.19 


4.12 


4.21 


4.28 


ml Have a positive attitude 
toward learning 


4.82 


4.82 


4.88 


4.69 


4.86 


4.18 


4.07 


4.15 


4.11 


4.28 


,;n. Prepare for futher edu- 
cation 


4.63 


4.43 


•4.62 


4.62 




4.02 


3.89 


3.79 


3.79 


4.32 


/ o. Improve interpersonal 
"and aoclal skills 


4.58 


4.46 


4.41 


4.72 


4.67 


4.21 


4.11 


4.06 


4.36 


4.28 


^/'P. Other (please specify) 

■ 


(2.0C) 


(5.00) 


(5.00) 


>.oo^ 


0.00), 


i.eo) 


(5.00) 


(—) 


;i.0(| 


5.00) 


Average 


4.75 


4.72 


4.70 


4.72 


4.82 


4.1V 


4.10 


4.10 


4.19 


.4.29 


* * ' « 

' • ' *- ■ .1* 
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CAREER EDUCATrON. PROGRAM 
RESEARCH FOR BETTER SCHOOLS. 
BOOK OP MEASURES 



1. NAME OF INSTRURENT; Expertenc«i Wsnurr^ ^tt. n.m>.j..p^i. n^^^ ^ ' 
Questionnaire (ERDQ) V 

ft . ' . - • . 

•2. ••RATIONALE/OBJECTIVE Of"^ INSTRUMENT: ThU Instrument Is deslaned" * 
to collect b^isic descriptive Information about experience sUes 
utilized In the £BCE jsrojects. ■ ' 

' ' * ' ^ ■ \ 

3. > RESPONDENT' GROUP; The form Is to be complejted by persons represent- # 
Ing the sites Involved." They may 'be contact "persons, resource,/^, 
persons or other representatives depending on the particulars 
of participation. / ^ ' ■ 

^' HISTORY OF THE DEVEtOPMENT 0F° THE INSTRUMENT ; Most of the content of 
this Instrument was embodied /In the Empl.oyer/Resource Question- . 
na I re used during FY y'*. Demoqraphjc and backqround -It^ms "were. 
» extracted, and It was* reasoned that this basic 1 eve J j)f information 
^ about sites_was essential and should be collectted independent from 
various attlfudlnal Items whose. Inclusion reduces the response - 
rate. 



. 5. 




ITE M,<n>^TENT ; The EROQj Includes name of sponsoring organization-, ; 
"name of representatjive, position of representative, address and 
telephone for representative, number of persons Involved In 
EBCE Instruction, fiscal structure, scope of opeVatlons, types 
of products, pum'ber of enjployees, character I pities of employees, 
other educatlon,al Involvement and Initiation to EBCE. Most / 
Items are multiple choice. " , ! 



6. , ADMINISTRATION PROCEDURE ;"" This Instrument, was designed for Individ- 
/ = ual Interview .conditions. Other method's have been fpund to be 
discouraging with regard to completeness of response. Time 

, \ required is approximately 15 miniites. It 1s Intended for a one- 
time admlnlsti'^ltlon. ' 



7. 



SCORING PROCEDURES/SCORING INTERPRETATIONS ; ^^d I vidua I Item resultfs 
are discrete.. Items are used for descriptive pui»pose*S and demo- 
graphic Input' analyses. "^^ .... I 



ERIC. 
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8« REHABILITY; Not formally determlne<l. 

■(,.','■•'■■• 

9: VALIDITY : Not formally determined • 

10. DISSEMINATION; Results In a group form are provided to NfE ^and the 
. ' other EBCE project staffs. 

IK TECHNICAL DESCRIPTION: ^ Since this Instrument has not been administered 
as a separate entity, no results are available* ' ^ ^ 

12. RECOMMENDED REVISIONS: The Instrument as. appended In Attachment A 
represents th«^ recommended revls,l>n for FY ?$• Since only 
Umtted^dita we^e available for analys?ls, much of ^he revision 
. resulted "^rom dlicvsslons with EBCE evaluators and conceptual 
considerations. \ , \^ 



ERIC 
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' ' ■ CAREER EDUCATION PROGRAM 


\ 


EXPERIENCE RESOURCE SITE DEMOGRAPHIC DATA Q.UESTIQNNAI RE 


This survey- Instrument Is to be completed for each experience resource 
site utilized In EBCE progfams • ft Is to be administered by prpgram staff 
to the contact person, coordinator or other designated representative of 
the sponsoring organization, , . c 


Sponsoring Organization: 


Site, Representative Name: • s 


Position: ^ • , - 


Address: 


Telephone: Date: 


A. 


Please Indicate positional category for site representat^lve. 

<t 

Dl. Administrative 
□ 2. Operational 
□3.^ Self-Employed 




Please Indicate representative's function within EBCE program. 

QK Contact Person 

□ 2. Instructor ^ 

Q3. Both Contact and Instruction ^ 




Are there additional persons involved in instruction f^r EBCE 5>tudents 
at this site? 

□ l . ' -No 

P2. Yes. How many? ^ ' < • 


0. 

•4 

i 


Which^, term best describes the fiscal structure of the sponsoring 
organization? 

□ K Profit ' ' f 

□2. Non-profit 

Q3. Governmental Agency 


" » / . 


0 

# 

, • ■ I. 

<• 
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E. What Is the scope of operations of the sponsoring organization? 



□ Local 

□ 2. Regional 

□ 3. National 
QA. International 



1 



Below Is a list of cafegorl.cs covering the types/of products and 
services typical of many organizations. Plelse check those which 
are descriptive of the sponsoring organization, and underline the 
one which Is the most descriptive. 



r 



_ 1. 

□ 3. 
k. 

5. 

6r 

7. 

8: 

9. 
10. 

n. 

12. 

13. 
lA. 

□ 15. 



Agri-business and Natural Resources 
Communications and Media 
Construction 
Consumer and Homemaktn^ 
Envi ronment 

Fine Ai;ts and Humanities 
-Health' 
Hospital I ty and Recreation 
Manufacturing 
Marine' Science 
Marketing and Distribution 
Office and Business 
Public Service 
Personal Services 
Transportation 



G. What iKthe approximate number of employees In the organization? 



H. What is the appro)oimate percentage breakdown of employees? 

1 . . sbx 



% Male > 

% Female 

2. ETHNICITY 

% Black 

% White 
% Other 
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I. Is the sponsoring organization involved In other programs for secondary 
school students? - „ , 



□ l. No 

□ 2. Yes. How many? 



7-2 
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J. How wd$ the organization Introduced to the EBCE program? 

BK Program personnel contacted us 

2« A student talked to us about the program 

83* Another employer talked to us about 'the program 

^. Company personnel , talked to us abouf-irhe program 

DS*^ Other (please specify) 

K* Why did t^e organization become Involved with the Career Education 
Program? 




CAREER EDUCATION PROGRAM 
RESEARCH FOR BETTER SCHOOLS 



BOOK OF MEASURES 
NAME OF INSTRUMENT: Cluster Test bf Knowledge 



RATIONALE/OBJECTIVES OF, INSTRUMENT: . These instruments are 
designed to measure the extent of intended knowledge 
. conveyance through exposue to employer cluster learning 
activities. The instruments, are intended to provide 
effectiveness feedback to employers, developers and students'. 
They will also have summati ve impl ications. - ^ 

RESPONDENT GROUP ; All students in each cluster are to be 
administered the appropriate Instrument for that cluster. 

HISTORY OF DEVELOPMENT: This was conceived as" an approach to 
filling a gap In the measurement of learning effects of career 
education programs. The instrumentation effort was begun in 
the middle of FY 7^^, and continued to the beginning of * FY 75. 
Resourcesr^werr. not. avai lable to itiount a sustained effort of . 
sufficient scope to meet the problem,, but some i:udimentary 
instruments were produced and experience gained. 

■ • ' 

ITEM CONTENT; I terns cover equ i tably employers actively involved, 
in the cluster of learning activities. Each cluster 
require^ a separate instrument. These may later be general ized 
and reduced into* one instrument- - I t^nls are derived from the 
actual program contenti they reflect employer perceived 
priorities. Items are multiple-choice. 

ADM IK t STRATI ON PROCEDURES ; These tests are administered employer 
sites by the Employer Coordinator, or his designate-, in a 
cluster pretest-posttest design. Administration time s'hould 
not exceed 30 minutes. • 

SCORING PROCEDURES/SCORING INTERPRETATION S: Number of correct ' 
rctsponses are indicated for;, each student. Gains for each 
student are rejcorded. 

RELIABILITY; Two cluster tests were administered, one on a pro-post 
basis* the other a pre-test only. Seven (7) cases wore available 
for both pre-test sessions, j 
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KR-20 (Utilities cluster) « .71 
kR-20 (Health cluster) « .81 ^ 

' i * 
S/^c (6) of the original seven cases from the Utilities cluster 
took the post*test. • . ' 

Test-Retest Correlation * .23 
KR-20 (Post-Test) \ ».82 

9..^ VALIDITY; Content Validity: The instruments were constructed with 
the input and assistance of Employer-Coordinators, As these 
Employers have an extensive understanding of the content 
universe for their patjcular cluster. >7his Instrumenr reflects 
^n accurate conception of measurable knowledge. 

Face Validity: Items deal with the content of specific 
clusters.. 



) 



Construct Validity: Insuff icient'data were.avai lable to 
analyze construct validity. 



10. DISSEMINATION ; Data were used as feedback to counselor coordinators. 

11. TECHNICAL- DESCRIPTION: Meahs were, computed for each testing. 

Cluster 



Mean 



Pre 17.00 
Post 21.26 



Utilities 
SD Range 

2.08 13-19 
1.65 



Mean 
19.29 



Health 
SD 



Range 
I3r26 



Total PoslSi-ble Score: 



Utilities 
Health ' 



36 
35 



12. RECOMMENDED REVISIONS ; More devielopmental work is n'e^ded before 

~ revisions can be suggested. In particular, a larger respondent 

pool needs to be constructed. The present effort is regarded 
as an initial and rudimentary ■one. Substantial resources 
would be required to accomplish the scope of instrument 
development connoted by cluster tests of knowledge. .Instruments 
■ as they were .admin iste red in Fy 7^ are Included in Attachment A. 
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UTILITIES CLUSTER TEST 

H««e: ] jPretest 

Datel , [ ' Posttest . . 

As a student In the Career Education Program yo\^ have been participating 
In an exploration of the careers in an employer ^duster area, in^this case 
UTILITIES, ' ^ / 

Toil are involved in learning activities vhlch are presented by employers 

^ • 

in tbls cluster and designed to give you M.nf ormation and experience related 
to the vorid of work. This test is being given to /find out^hov veil the 
cluster experience is providing you vl^h the Information Intended. 

> The pretest is administered near the beginning of the cluster activity 
to find out what you already knov. The posttesl is, administered near the end 
of the cluster activity to find out what you have learned through the exper- 
ience. After the posttest^the answers to each question will be 'discussed* 

• / • 

I 

Each question' on this test has fa6r answers from which to choose* Place 
. ^ ' ■ 1 X . ^ ^ ^ ' 

a check mark Ih the box next to the an^wki^ you thlnH is correct* 11' more than 

one seems to be correct, mark the one that Is most correct. Do your best, 

did make certain that you write down your name and today *s dat.e in the spaces 

-provided at the top of this page. i 



UTILITIES CLUSTER TEST - FORM A 

1. What •aell does natural gas have? 
, I I a. Sveit ' ^ ^ 

c I I Bitter . ' ^ 

I I c. It has no ^11 
I i d. None of the above 

2. Where Is natural gas found? 
I 1 a. ' In tlie air 

1 I b. In the ground 
( I c. In oil 
d. In water 

3. At what pressure Is natural gas pumped to your^home? 
I la. 

CZ3b. - <. 

, I I d. All of the above are possible^ 
4* How Is natural gas formed? 

[ . i a. It Is a natural by**product of crude oil 

I I b> Pockets of gas were trapped, when the earth cooled 

I J c.. Nitrogen and Hydrogen combine under Intense pressure 



Id.. None of- the above - * 

5. What Is the function of the McElroy Analyzer? 

( Checks the pressure of t^e system of ,plpes and trtalns that 

punqps natural gas 

* • * 

1 I b. Determines the quality of a given gas sarnifte 
I i c. Analyzes a cus'ton^j^s natural gas needs <v 
d. ^1 of 'the above ^ / 
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6t To which dcpartaeat would a customer be< referred to report faulty 
equipment? 

■r 

I I «• Ctiatoaer Service, Customer Relations 

Research Department 
Dlflrtrlbutlon Department 
! I d» Transportation Department 
What doThe initials LNG stand for? 
f^" ! J t> Licensed for Natural Gas 

. , * ' 1. ' 

\ I b. ^Lawrence Nelson Gregg 
I I ce Liquified Natiural Gas 
i l d> None of the above 

What is the^ function of the Transportation Department of a utility? 
1^ I a,^ Repair conqpany vehicles 

i I be* Schedule uae of company vehicles ^ 
i I c. Distribute the utility to the public 
I ' I d* ^ Both a and b are correct 
K Metural gas can be used for^ , ; 

I | e/ Lighting ... , 

I [be 'Cobking ' I" ^ ^ ^ ' 

\ I c. Heating 
I I de All of » the above 
e What is thia primary cofiponent of natural gas? _ * 

■ f I ee Ca'rbon , 
^ nH^^ Oxygen 
( ' I Ce Sitrogen 

I j ^e Helium • * ^ / 



FORM A 

11. In what city vas the first gas company located? 



I i b. 
O c. 



PhlUdelphla 

London, 
Paris 

None of t^e above 



12. Vliat source of information is most often used by utility /companies 



r~i >>• 

d. 



for new products? 

Customers 

Encyc loped fora 

I 

! 

Research staff 
Company employees 



il3e It Is possible to produce natural gas by burjji;Lng 



a. 



Coal < 

Wdod 

Plastic 



\ j f d. None of the above 

\ 

14. \ What is a "job freeze"? * 



a. . A situation where emp).oyee8 must work outside in cold weather 



/O K- 



li] i. 



When people are only hired for certain Job classes 
When there is littl4 or no hiring done 
When there is more jhiring than usual 



15e What is a **joV freeze** caused iby? 

' \ ' \ a. Bad employer -^employee relationships 
' I I b. Cold weather 



.An excess » or extra » amount of money available for hiring 
I I dt Too llttAe money. available for hiring 
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FORM A ^ . ' ^ 

' ' ^ • ' *i 

16. Below are four statements which could possibly be applied to clerical. i 
Jobs. Select the one which besi .describes the Interaction between an 
^ organization and Its cl/erlcal positions. 

' r ' • 
1 I a. Thejr make an organization "goy'by using many skills to do 



many Jobs 



1. 



. 1 I b. They are not covpred by (Jlvll Service 



They- will soon be eliminated or exided, as useful tools In 
an organization 



I I d. They only Involves typing, stenograsbyr'and answering telephones 
17. What Is the function of chlorine when added to water? 

I 1 ^ a. ^ Kills,; germs 

1 I b. Reduces acidity prolongs life of plpes^ • 

I • c. Reduces off-tastes and odors* . ' ^ . > 



1 I d. Preventp tootl^ decay 
18.' What Is the function of lime when added to water? 



3 4* KlllGf germs 



I > I b. Reduces acidity, prolongs life of •pipes 



c. Reduces off~tastes and- odors 
i I |, d. Prevents tooth decay 
L9. What Is the function of alum when added to water? 



J 

1 



\^ 4 



Causes dirt particles to group together, which quuses them 



to become trapped 
I I b. Reduce of f^-tastes and odors 
c. Previnti^' tooth decay 



\ I d. • Kills- gertaa 



-I 



«■«/ 



/ 
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20* Wbat l8 the functlt)n of carbon when added to water? 

' T I Causes dirt particles to group together, which causes them 

to becoipe trapped 



Prevent tootH decay 

|r I Kills germs 

d* Reduces ^off^tastes and odors 



/. 

, 21 ♦ How does the Water Department differ from the Gas Worjcd, the Telephone 
Company,. and the Electric'' Company?/ / ' 

. I I ,a. It is a government agency . , * , 



^ I I b. It is owned* by stockholders . 
. . I ^'1 c. , It is geared to making profits 
I I d. Kone^ of the above 

I 

22 « 'The Water Department is responsible for' 



C 



] a. Keeping rivers flowing through complex, scientific methods 

1 • ■' .'I - ' I 

j. b» Providing drinking watef and treating sewage 



/ 1 ■ * I c. Taking care. of street signs and traffic lights 



d/ Cleaning streets near its plants 



23. How many unit^rocesses are* there in water* purification? 

* ■ * 



a. • iPwo 

b. Three 
'c. Four 



I 1 d. Five 



V 



< 



1^ ' , . . FORM A 

'24. * Which of the follovlnj^ Is not^a unit process of vater purification? 
I >^ I ^a. . Coloring \ ' ^ 
} I b. Lline and alum treatment 

|. ^ [ c. Settling J chiorlnatlon, and fluoridation ^ : 

le ^bove • ^ 1 ^ . 

25. Which of the {olloigfeLng is not a process us^d In Water Pollution Controls? 
1 . I a. Bar screening 



d. None of t 



b* Settling ^ 



^ I ^ I c* ^Aeration 
f I .d. SfcUlng, ~ ^ 
26. What is. the function of vater meters? * ' , . I 

\ ; ^ . , . . • , . ^> 

I > I ^a. Tell time by using water -flow systems ^ ' 

1 \ b* Blavor water mi * » 

1 M c» Color vater .1. 

I J ^ ^ ^ ^ 

. ^ h I 'd«^ Record the amount of vater customers use over 9 given period of time 

■ I • ' • ' ' ■•• ^ < : 

J:7^ Wnat^ls* the function of severip?^ 

I I a. To carry ^ clean vater to customers ■ * 

• [ I ]b* * To be paved like streets by Brick. Masons 

[ I c* To carry vaste and storm ^vater to plants for trea.tm^ent ^ 
' I ^ I ud* To carry vastevater to the rivei^s directly 
28 Why sis a unlon> agent important to all employees in Civil Service? 
^E^3^*^* — I^^'iw^otlates tax rates . ; . 



I I b. By his or her honesty, the unlon^s position can be represented 

in a reasoxuble manner » or by dishonesty / can be unreasonably 
- — . ; ^ 'represented ' y ^ . ^ '^ ^ 

r* ^ c*^ He' or she catv^present^all employees , even though some are not 
in his union • . " , , 

I I d* Hone 01 the aboye' ^ 



' 29.,, 



/ 
/. 
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To vhoi^ should an employee first take\vork-related problems? 
I I al To the union steward 
I I bi Tp his immediate supervisor 
I ' \ c.l To his friends | 



d«l To the head of the organization for which he works 



30 « A man should not really- consider applying for a job as 



I I a, l^Clerk ^ 

b, Wenographer 



Q c- '^pist 
1*^ I d. !Jbne of the above 

. " • - . i . . \ . 

; 31 « A^woman should not really consider applying for a job as 



a. Typist 



rZZl b« Fireman % 



Chemist 



None of the above 



32- 



Of the following dassif Icatioips of jobs, which has! the highestL average 
salary? ' ' ' ! 



/ 



33, 



a. Customer representative 

r 

b. Chemist j 

c. Draftsman 

d. Typist 



Of the following classifications of jobs, which has t 
•alary? 



a. Customer representative 

b. Chemist 



he lowest average 



I c. Draftsman 

IZ3 Typist 



FORM A 

34. In order to be a draftsman, It is necessary to have which of 
following types of education? 

L J a. High school diploma » * 

I I b. College degree - 



the 



J c« Trade school diploma 



I I d . Any of the above 



.-.•.r£^'^^n;iSrder to be a secretary, It Is necessary to havfe which of 
following types of education? 



the 



High achool diploma 



I I b. Trade school diploma 

I . I c. College degree 

J • \ * ' ' ' 

d. No particular educational training Is necessary 



36 Before being hlred.»,^ j&vBry new employee Is 



J a. Given a written exam 



I I b. Interviewed , 

I ( c. Given a skill test ^ 

/ I I d. All of the f.boye * 

37. If there Is a dlsput between an employee i^d his supervisor, it may- 
be necessary to discuss the issue between them. Whose responsibility 
is it to initiate the discussion? ^ 



a. 
b. 



I i c. 

d. 



The eiiiployee 

The supeirvisor 

The grievance officer 

Both a and b are correct 



\ 
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MAOTTACTCRING CLUSTER TEST 



Date: 



Pretest 
Posttest 



As m •ttident In the Career Education Program you have been partlclpa^g 
In an exploration of the careers In an.employer cluster area. In 
KANUFACTDRING. ' ^ , 




a case 



You are Involved In learning aQtlvltlea- which are^ presented by employers 
In this cluster and designed to give you information and experience related 
to the vorld of work. This best is being given to find out how well the 
cluster experience is providing you with the information intended. 

The pretest Is administered near the beginning of the. cluster activity to 

find, out what you already know. The pos'ttest la administered near the end of 

* / ■ 

the cluster^ct4T5*ftfcj>to find out what you have learned through jthe experience. 

After the posttest the answers to, each question will be diffcussed. 



Each question on thlf test has four answers from which to choose. Place 

a check mark' In the box ne xt to the answer you think la. 'rorra/.«- r.f m^rf 

than one^i^to be correct, mark the one that is most corfect. Do your 
best, «nd make certain that you write down, your name and today's date in the 
spaces provided at the top of this page. 



■ t 



MANUFACTURING CLUSTER TEST ^ FORM A 
What ^cK^he letters CAMS stand for? 

i . I a/ Cybernetic Anthropomorphic Manipulator Systene 
I ) b. Cybernetic AnthropoMorphlc Systems 

9 

! j c. 'Cybernetic Anthropomorphic Monitoring Systems 



1 d> .Cybernetic Analysis and Monitoring System 
Which, pf the following Is not a function of CAMS? 
I ! a. InstSalllng plate glass ^ 
I ! Reaching Into furnaces 



Q c. Constructing furniture 



_[ d. Stocking and loading. 



Below you will find 3 lists of words. Ihree of the wore* la each liaty are 
descriptions of orbits; one is a technical Category ororMt. Choose the 
word iniibhlist which 1b a cateporv bf orbit. o 



a. Sub-orbital • 



I : b. Space 

r ! c. Ballistic 



Jd. Elliptical 



I 1 a* Orbital 



I b. Space \ 

! ' c. circular ^ 



d ; Int er-contlnental 



\ a. Sub-space 

] b. Inter-planetary 

' c, Inter-^contlnental 



j " I d . "Re-entry 
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\.. What do the Initials RES0 stand for? 

{ I a. Ren-entry and Experimental Systems Division 
I I b. 



I I b. Re-entry Engineering, and Security Division 



7. 



8. 



9. 



10. 



What does CAMS requlr^ In order to work? 
t a. ^ Computer 
I b. Man 



c. Revival and Envlronpiental Systens Division 

d. Re-rentry and Environmental Systems Division 



c. i Instructions 

d. Satellites 



f 



Wtmt does, cracking mean? 

I a. The process of oil coming from a well 
I b. Splitting oil molecules into lighter, smaller molecules 
I c. The action that takes place when an oil pipeline bursts 



3 d. Vo^of the above 



Which of the following is not a by-product of crude oil? 



a. Gasoline 

b. Long-playing records 
Water color paints 

d. Sunglasses 



?6r whom wad* the first well named? 
I a. Edwln'L* Drake 
1 b. JBenjamln Slttlman 
I 1 c . Robert Grlswold 
I j d. James M. Townsend 



ERIC 
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11. 



Which of the following represents the correct order of th* weight pf oil, 
gasollng and water from heaviest to lightest? 

\ 

' • \ 

*. Wajtar, oil, gasoline \ ■ 



12.. 



What. two chemicals 'make up most of petroleum? 



13. 



15. 



The instrument that helps people find oil also does something el&e. 
What else does it do? . ^ 



b. Oll» gasoline, water 

♦ 

c. Gasoline, oil, water 



3 d. Water., gasoline, oil 



k. Hydrogen and gasoline 

b. Carbon and oxygen 

c. Water and carbon 

d. Carbon andf' hydrogen 



J a. Finds water 

1 b« Determines earthquake severity 



eg ! c. Pumps oil 

~| d. Records heart-beat rate in cardiac patients 



s 



An oil still is a piece of equi^ent used in the refining process* l^iat 
is the function of an oil^still? - ^ 



a. 

b, 
c» 
d. 



Separates crude oil into its various factors 



Makes synthetic oil 
Mixes the oil with alcohol 
^ixes the oil with a catalyst 
How many gallons in a barreJLcof crude oil? 
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a. 50 

b. 48 

c. , 42 

d. lione of the above 
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FORM A 



16. 



17. 



18. 



19. 



What percentage of crude oil is gasoline? 
f la. 17 



On average, what is the 'moat economical way of ^ transporting oil? 
3 «. Tankers. ^; ' . 1 • ;. ^ 

. I .Railway tank cars, i- ^ ^ 
I c. Highway tank trucks 



20^. 



25 

d. 50 



Who ^vns public com^panles? 
a« Presidents 

^ Stockholders 
c • Workers 
d. Board Members 



I I d. Pipelines 

What is the primary function of the Research branch of a company? 



a« Development of new and Improved products, tools and 
• processes ' ' ^ 



I I b* Research customers* complaints 

I c. Research possible stock markert Investments 
f d* Np.ne of the above 



What Is the primary function of the Production branch of a company? 



Documents 



a.' I b^* Servicing Products 

c. Manufacturing go^ds and services 
d« Evaluation of products 
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* • * FORM A 

What Is the* primary function of the Marketing branch of a compaay.? 
I * a. Training staff 



I I c. , Evaluating products \ i 

I d. Selling 9nd distributing pro'ducts to consumers 



What Is the primary purpose of a company Involved In manufacturing? ^ 
r 1 « " ♦ 



. V * * 
b. Servicing ptoducts ' i 



a. To manufacture a product 



Jx b. To make a profit * 

To serve the consumer / 



d. • All of the above ' ^ 
Which of the following Is not considered a ^support service department? 



a • Legale 
d. Medical 



0> 



c, * Marketing * t 



d • Computer 



9 



Crude 9II is separated into "factors" by 



J a. ^ A catalyst 



^ b., A cracker 



c, A stiia 



d. None of the above' ^ J ' \ 



9i^ 



FORMA 

25. Below you will find groups of Important topics 'or Issuss concerned vltli 

our society. Choose the one group which contains a non- gnvlroranental issue. 

I I a. Air pollution, undersea exploration, oil and water separation 
I I b. Bousing, solid waste disposal, health problems 
I \ c. Water resource disbursement, supplies of lumber 
I I ' d. None of the above ^ 

26. * A seismograph helps^ sc^lentists 



I ! a. -Find oil 

I I b. 'l-ocate earthquakes 

3 I I c. Both a and b are correct * . > , 

' ' * - • a , ' ' N 

* — — • , . 6 • 

I I d. None of the above • . 

^27. Of the following classifications of jobs, which has tht^ highest average 
. salary? * ^ t * 

I I a. Cuaton^r representative ' 



V * 



I I b. Chemist 
\' \ c. Draftsman. ^ ; • 

. d. ^T^-pist ^ . • . ^ : 

28. -Of the following classifications of jobs, which has the lowest average 
salary? «ir . ' ' / 



a. , Customer Representative 

b. Chemist 

c. Draftsman ^ 



] ds Typist' 



29.^ In or4er to be a' draftsman /it is necessary to have which of the 
, following types of education? 



I } a. High school diploma 

j I b. College degree 

I I c.^. Trade school diploma 

I • I d. Any of the above , 
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30* In order to be a 8ecret£^y» It Is nexreasafy to have which of teh 
follwolng types of education?. 

f I a« High school, diploma ^ ^ 
^ I "I t.. Trade school diploma, . 



College degree 



31. Before* being hired, every new employee Is 



No particular educational training Is necessary 



a* G^ven a written exam- 



1 b. Interviewed* v 



3V 



Given a skill t^st 



dl All of the ^ove / 



32, If there Is a dispute be.tween a;i employee and his supervisor. It may 
be jaecessary to dlscuss'the Issue between them* Whose responsibility 
is iC^to initiate the discussion? . 



1^ I a* Th^ employee 



b V fhe ^^upervlsor 



□ 0. 



The grievance officer 



d, 9 Both a and b are « correct 
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HEALTH CLUSTER TEST 
\ ) PreteUt 



Kb a student in the Career Educai^lon Program you li^ve been participating 
in an exploration of the careers in an ^lojet cluster aresv in this case 
HEALTH* \ y • / ' ^ ^ * ' ^ / . . ' / 



/ 



tou are involved iinv learning activities vhlch^are preMnftod by employers 
Ip this cluster: .and d^igd^d to give you information and experience related- 

to the world of wQrk.\ This test is being given to find out how well 

• ' ' . , / / 

cluster e^erlence is Providing you with the inf^prmation intended. 

• * ■ ^ : ^ . \ \ , 

The' pretest is admin^sterj^ t^^af the beginning of the cluster activity 
to f Ind^out what you already know. The posttest is administered ne^ the 
end of the cluster activity \to find out i^at you have learned tl^tough/the 
.experience.* After the posttist the answexfs to each question will ^e/ 




■ ■>.• 10 •! i ' V ' • / ■ 

.•■ • . \ ' ' ■^• " ^ ■ 

« Each, question on •^Is test ha* four answe^rs frdk which t6 choose. 

■ • ■ " • ' -\ I'- ■ » . ■ 

Place a cheek mark io tfie box next tp the ansver you think is correct. If 
more than otie seems to be correct, laark .the one that inmost correct. Do 
yo^r best, ^d.make certalii that you write down you); name and today Is / 
dajtre in the spaces^ provided Wt the top of this pag^ . 



'.. ' -9A- ■ , 
HEAI^Jk<tMISTER TEST .'FORM A 



What dtjthe Initials E.R. stand for?. 
a« Endocrlnal Res'prlatpr 
bv. Emergency Room ' - 



I l ^c. Energy Reserve \ 



-^l 'None, of^tthe above 



What Is' a suture?- 



1 



a* Needle 



l\ hr Thread 

/J ^ /' 

I \ c. Harame?: 

/ ^ / 



J Clai 



Whaf does NO/mean? 
i I a. Nltrpus/ Oxide 



J b , North Olney 



Nittric .bxlde 



j d • Novum Ovd^y 



What Is the 



j ^* To 

' t>/ ~To 



What is the 



primary function of the Dietary .Unit? 
help patients lose. weight 
help patients ga-ln weight* 

c» To 

V 

d. Notje of the J above 

purpose' of* the SMA-12? 



prepare meals for all patients v 



a/ Keeps one dpzen eggs at 53 



[' I bs» ► Takes blood prea/Bure J 
j c* Reniovfes plasma from blood 
[ dv Analyzes blooci samples . 



r 



-95- 
FORM . A 



MiRiat do the initials RN stand f<Jr? 
> ' Royal' ;Navy • ' \ 



b^. J^escrye Nurse 



i ' t c. Roentgen 

I d. Registered/Nurse '\ 
If a blood sample is said to be RH+, it is 



a. Acidic 



] b« , Basic , * 



[if ] c. Neutral 



M I d. None of the above 



f8\ tlhat^type ot/dJLet should ^a diabetic -be kept onl 



a. . High-cholestorol 



j J[ b. Low sugar ^ 

/ ! A c* wfigh sugar 



d. Bread and watfer for two weeks 



9. Vhat 'is -insulin? 



^ a. Sugar / ' i \ . . 

^/()T^\An enzjfma tic' compound present i\i*dlabetics ^ 
c. • A noh-caloric sugar aubstlttite - \ ... 



_7j d. A hormone, norm)alJ.y secreted to metabolize carbohydraLea 
10. Vn)at|fiun^^ tll'e Inhalation Therapist scr.ve? ' ^ y 

! a. Administers |mouth-to~mouth resuscitation ' 



r^~2'b. Administers diUiS^to pfitients th'i^ough Inhalation 

r c * The ^ ^ame as an anaestheslolo^ist \ • ' ' 

I d. ;None of the above . 



:RLC 
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11^ What is„a Petrie dish? 

! I a, A small container used In the conduct of 
^ Blo-chem^cal experiments 

[ZZn A small dish used by the Dietary Unit 

c- A small cont ainer used by burgeons dur ing an operatio 
None of the above 



12. yWhat do the letters OR stand for? 

J a. Oxygen Room ^ 



1 b. Operating Room 
J c. Only Receiving 



^ d. Operations-^^nd Recovery 



13, '^Vhat is the function of an Anaesthesiologist? 
j I a. Puts patients t© sleep 
I I b. Takes X-Rays 



! c. Sets broken b^nes 
^\. ZZ3 ^' - Analyzes blood 
14, l^hat does a Radiation Therapist do? 
^ t a. Puts patients to sleep 



j_ I b. Takes X-Rays 

• I c. Administers drugs to patients through inhalation 

^ . [ ' d . Analyzes blood 

15, What is an Out-Patient? 

I > I a. One who is too strung out on drugs to be helped 

I { b. One who has been released from the hospital, but still comes 
in for treatment 



[ZZI Orf^who walks out of the hospital 
' I ^' 'None of the above 
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FORM.A 



16. Why are masks worn during an' operation? 



ERIC 



18, 



19, 



a. So the patient can't identify the operating team 
afterwards • 

b. To protect the patient from germs 



2 To protect the operating team from germs 
^ d. To help the operating team breathe 



17. What is the purpose o# a scalpel? 

^ a. To hold two pieces of skin together 

t ' b. To sew two pieces of skin together 

, \ c/ To take a blood sample 

i d. To tnake a cut in a patient: 



What is an incision? 

a. A cut made during an operation 



! b. A wound 



1 c. . When two doctors call in a third doctor for his 
opinion about a patient 



' i d. The rules a pharmacist follows when making a drug 

A patient is having trouble breathing. Of the following, who would 
the best to summon to* his aid? 



be 



a. An Anaesthesiologist 

b. A^Re'spriration. Therapist 

i I c. housekeep^ef 

1 I d. Surgeon 

u i 

20, The function of the bio-chem lab .is 

CZm ^' ^° analyze blood samples 
• * *' ' ^ 

b. To aid doctors in making diagnosis 



I I c. To conduct experiments 

! n d. All of the abovfe ' 
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21. Blood is made up mostly of 



22. 



/ 



23. 



\ I a. Oxygen 

b. Nitrogen 

J c. Plasma 

d. Glucose 



The human body is 2/3 

{ 1 ^ 

\ I a. Oxygen' 

' I b. Water 

I - ! c. Tissue 

d. Organs 

What do the initials LPN stand for? 
; . a. Licensed Pediatric Nursfe ' 



J b. Limited Practical Nurse 



I c. Licensed Prtttical flurse 



! d. Long-Pulse Needle 



The function of the Social Service worker is 
a. Undetermined 



J b. To aid clients through personal problems related to* 
health situations 



c. To organize staff parties in the hospital 



' d. None of the above 



25. 



Social Service Workers must be 
- I a. M.D. 's 

I b. Psychiatrists , 



^ I c. Trained counselors 



■ m 



FORM A 

26V In order to be an anaestheslologlst , one must also 
I j a* A nurse - ' * 

I I b. An M.D. " ■ 

.- ! i c. A'Radlatlpn Therapist 
( • I d. "Male 

27. Blood that is non-acidic is r said to be < 



^J-ars — RH--pes4rtive--ar— neutral- 



ry^ 'b* RH negative or neutral' 
c. RH neutral only 




\ |\d. None of the above 



28. A primary symptom of diabetes is 
I I a. Abnormal urine 

j [ b. Excessive sugar in the blood 

• J c. Insuf f icierlttsugar in the bloody 
\ I d. Loss of appetite » 

29. The person responsible for taking X-rays* ia^ the 
* j a. Inhalation Therapist 

I ; b» Anaesthesiologist ^ . 



J c. Radiation Therapist 
1 d. Surgeon 



30. CTo protect patients from germs during an operation 

a. He is anaesthetized 

b. A screen is erected * ^ 



'c. Masks are worn 



\ ■ 



FORM > \ <r 

31. Of those careers ava liable' in\ , the health-care field, 
which provides the greatest financial reward?. 

- [ I a. Hospital Administration 

I j b. Nursing ^ 

I I General Medicine (M,C.) 

{ I d. Specializations (M.b.) 

32. Of those careers available ia the healtii-care fdeld, 
which prdrvijdes tlie greatest mental or wpsychologi cal 
y a t isf ac t ion? 

J j a. Hospital Ad mi II istraLion 

• [^^ J b. Nursing, practicing medicine ' - , 

r _ - c. Lab technician o 
I I cT. Each individual must decide for himself 

33. ^ In order to be an,M.D., it is necessary to have which of 

.the following types of education? 



[ . { a. College degree 



\ b^ Graduate degree 



I I c. Some college study ^ ' 

I Trade school diploma ^ ^ ' 

34. In order to be an x-ray techni'clau, it i^s necessary to have 
whicb of the followl*ng types oC educaLioi^? 

^ * j ^ ] a. College^ degree^ 

I" I b. Graduate dugred' ^ 
•« * ♦ 

[j^ J' c . Some co/llegc ,^tudy ^ ^ 

[ ; d. Trade s^chool d^ipioma , 

^5. In order to bo a nut"scv, or^e must bo. 

[ ]] a. k fcmaJe . ' ^ 

\ \ b. Dedicated to helping others . 



[ ) c. Trained in ^he fundamentals of medlc^ine 
I d. Both b and c are .correct 
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CAREER EDUCATION PROGRAM 
RESEARCH FOR BEHER SCHOOLS 
BOOK OF MEASURES 

9 

1. NAME OF INSTRUMENT ; Assessment of Student Attitudes Scale (ASA) 

2- RATIONALE/OBJECTIVES OF INSTRUMENT ; This Instrument was designed 
to measure student attitudes toward learning environments, 
both traditional and non-traditional • 

3* RESPONDENT GROUP : This form was designed for administration to any 
secondary school students including EBCE experimental and 
control . * . 

k. .HISTORY OF 7HE DEVELOPMENT OF THE INSTRUMENT : the ASA *was 

designed during the summer preceedlng^the 1973-1!;/^ academic 
year af^d has been undeh development slacc^Jthat time. Details 
concerning this developmental process ma^Tbe found In 
» . Attachment A, 

tfc. • / 5* ITEM CONTENT : Itelrts werfe designed to cover attitudes toward educa- 



tion Iji general, school curriculum, school resources and 
school counsel I ng. Responses were recorded on five-pbint 
* -LIkert sc^lfes with Strongly Dlsagcee and Strongly Agr.ee as 
poles. 




S. - ADMINISTRATION PROCEDURES^ Amenable to group, Individual or mall 
* administration. Time for- completion Is approximately 15 

minutes. The ASA was administered as a pre and posttest during 
" FY 7^. . . „ ' 

i ^. SCORING PROCEDURES/SCORING INTERPRETATIONS: A scoring sheet is 
• / provided to arrange Items Into subtests and correct polar-lty ^ 

of scales. Indlvjdual subtest scores (k) and the total 

test score hafve* been us^d In analysis. 



/ 



8. ^ RELIABILITY : For the techhical sections detailed Information 
\ may be found In Attachment A.% Brief ly, "subtest to total 
score correlations ranged from .76 to .96. Split half 
reliabilities of .75 and .77 were attained during pre and 
post administrations df the Instrument. - ' — , 

5. VALIDITY : Teacher ratings* of students were used to establish 
a validity estimate during the pilot test stages. Student 
attitude scales were dichotemlzed to'ajlow a comparison 
between the directionality of test scor'es and teacher ratings.. 



ERLC 



-102- 



.An 88i rate of agreement was found. During FY /'f, the Instru- 
ment was also found tp discriminate between experimental and 
control groups on attitudina I change. 

10. DISSEMINAHON : Resjjlts are provided Ih^group form to NIE and the 
other EBCE project staffs. 

TECHNICAL flESCRIPTION ; See Attachment A. 

RECOMMENDED REVISIONS ; In addition to deleting Subtest 5, 
r Individual Item content may be subject to deletion or addition 
pending analyses which are currently underway. The Instrument 
is, however, workable In Its present form. 



n. 

V 

12. 



8). 



THE ASSESSHENT OF STOOENT ATTITODES 



SCALE 



Report 2 



Career Education Program ^ 
Research for Better Schools, Inc. 
1700 Market Street, Suite 1700 
PhMadelphla-, Pennsylv^lb 19103 



July 1, 197'* 



/ . 
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The <\ssessment of Student Attitude Scaje (ASA) wd^ Lsfjned^'^ 
as a mea.sure of- generaU^ed att I tudes toward School Jhd smver^]' 
Important elements of the school environment. In addition to a 
ta$al score,, the Instrument y^elds subtest scores^Jn tKe foll^Ing 
are'a^: ' r ' 

If .attitude toward education In general 

/ • •# - . • • O 

2., a'ttltude toward schooF currleujum - ' • - ^ 

-"3. attitude toward school resources 1^ 
^. attitude Jtoward scho6l counseling 
* ^ 5. attitude toward learning ^ 
The ASA was administered In a pilot form and revised to a 51 Item 
l-nstrument. Tfie processes Involved In this early design and develop 
ment are presented In "The- Assessment of Student Attitudes Scale" 
Reppr^t Ij No\<ember 20; 1973. The par{)ose of" the present report Is 
to delineate dw/elopment of the'A$A from'.thSt time throufth July 1, 
197A. - 

Prior to the pretest administration of the Instrument Ir the 
Pall of 1973,several\modlf-icatlor»s of the instrument form found In 
Report- 1, lAppendlx 3 were made. - One Item was deleted due to wording 
.difficulties, reducing the test to 50 Items." i;he Instructions viere 
revised for clarity and appropriateness for thd specific samples 
being tested. The wording of Items was adjusted to balance the. • 
number of negative and positive statements, /ai. scoring sheet-was 
also devised to render both pes 1 1 1 ve .and negative item responses on 
the SO!"- numeric scale (1 - low to 5^- high) and to simplify the 
production of subtest scores. Th^ five subt^sTs wert • reta Ined wl th' 



tern contents .as indicated in Apdendix A. The subtest breakdowns 



' and direttjdnal i ty the Hems aVe outlined in theVscorlngt sheet 

* ' -* • / • . ' 

at the end of the pretest, form. , • . ^, 

This farm of t^ia ASA was administered wfttrth^ pretest package 

to all FY 7^ Academy for Carce'r tdutatipn expirlmental , comparison 

and^ontext group students. The totaU subject^ pool was IS^- The 

responses were subjected to ,a rudimentary item anafysis consisting 

• of item intercorrelat^s, item-to-subte^t score coirtelationsii 

an9*~f tern- to- total score correlatioris, Sui>test scores were a?so 

analysed to determine whethfer they discriminated betvdeen tne various 

samples tested. ^ i * ^ / * . . \ 



The^e anafyses reyfealed thdf the subtest scores , had mfliimum , 
discrimination poy/er on the pretest, and^.th^t several i t§jDS, tf^ere > 

-\ - 1 • ' v.. ' . ' 

Impairing the iWterngl consistencyi,.pf the Irltytrument, TfcSe a^jtual 
results are not appended ,to this report due j to their sheer v^fcune 

^ I , ' ^' \ . ! 

an^l Interim ^nature, but .they, may be obtained upon request. The A^A 

was revised as an outcome of^the^e analyses/. 

The^f in^l 'revision of^the A^A was accomplished for post test 

administration in- the Sprlnci o> l^A. B^ed on the analyses of the 

pretest results 18 items were excluded./ Criteria utilized In ifils 
* . * : ' \ ♦ 
excliJslon were dbrrelatjonsiof less »tl^n 1^20 between the irem-and** 

-the subtest score of the total score. The folU)wi7it] Items were 

deleted: 9. 11. U. 15. 16. 17 20. 21. 25. 26!^, 39." ^0. . 

^6. 48. 50. The following Items were retained: . ' 

« I. Attl-tude Toward Education In General: k, 27, 28>' 30>, 32 
35, '♦S - 7"lt<ms .. . " 

2. Attitude Towjfrd School Curriculum: 1, 7, 8,. 29, 33 - 5 1 ferns 

3. Attitude Toward School Resources: 2, '3, 6, 13, 18, 22, 23, 
2'», 3.6, '♦7,- 10 Items . ■ 



h. Attitude Toward 'School Counseling: 5, 10, 37, 38 -5 
Items ' ' • - 

5. Attitude Toward Learning: , 3i|, kl^ ^3, ^5-5 itfems ' 
The Instrument was thus reduced to 32 Items. The order of presenta- 
tion the Items was again randomizer). New* instructions were 
written.; This revised ASA Instrument^ Is Included as Appendix B. 
The Item numbers In parentheses hndicate the pretest position of each 
item. The same format was used for both pretest and posttest scoring 
sheets to facllitatfe comparative analyses; This form of the instru- 
ment was administered as oairt of the posttest package to Academy for 
Career Education e^xper i mental , comparison and context groups. Analyses 

of the pqs^ftest data and* f omp^rat i v,e pre-post results form the basis 

^ ' . ' - • \ , , 

for-.final recommendations for the Assessment of Student Attitude"^ 
Scale. . ' 

Pre and posttest data were subjected to Interitem correlation. 
Item to subtest score correlation, item to totat score correlation, 
and subtest to/totaV'score analys'^s. On the basis of these resul^,^ 
subtest 5 (Attitude Toward Learning) was deleted f r(>m, the ASA and the 
correlations recalculated. * • ' 



Subtest 



2. Attitude Toward^ School Curriculum 

3. Attitude Toward School Resources 
^. Atti tude. Toward School Counseling 
5. Attitude Toward Learning 

SpH t hal f reJ labi I i ty , 



were as 


fol lows: 




Pre 


Post J 


^03 tp 


.96 . 


.87 


\ .99 




.76 


j97 


.11 


M 






.76 


.96 




.'♦3 




1. ' . 
.75 


.77 
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* 

r The revised ASA- now consists of 27 Items grouped to form k sub* 
tests regarding student attitudes. The order of Items will be ' • 
rerandomlzed and the Instrument wi 1 1 be In Its final foritiat. Decisions 
need to be made regarding the revision of the Attitude Toward 
School Resources Scale and the reconstruction of an Attitude Toward * ) 

Learning Scale. 

i . . \ 

- • , \ w 
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ACADEMY FOR CAREER EDUCATION 



Name: 



Date: 



ASSESSMENT OF STUDENT ATTITUDES 
PRETEST INSTRUCTIONS 

In developing the Academy program and planning for the future it is' 

important to know what students think about various aspects of their 

i 

eciucation. This questionnaire has been designed to give you an oppbrtunity 
to express your opinions about several fairly general educational issues 
based onyour experience, in school. 

, It Is Important to note that in this beginning of the year question- 
naire your responses should be based on your opinions of school last year, 
if you were in the Academy last year, then your opinions should be about 
how the Academy was last year. If you were in.Olney last xear. then 
you should be thinking about your experiences at Olney when you answer 
the questions. This questi onnaire is about last vear. not this year 
at the Academy. You will be asked to evaluate your present Acadeny 
experience later. 

Please read each statement, then circle the-number"^ on the scale 
below which shows the extent of your Agreement or disagreement with the 
statement. If you circle a higher number (4 or 5), it means that you 
agree with what the statement says. If you circle , a lower number U or 2), 
It means that you disagree. If you circle a -humber (3) at the middle 



ill 



-Ill- 

I 

« 

of the scale, it means that you're not sure how much you agree or 
disagree. 

Help change the world around you; help make a better school; fill 
out this questionnaire and let your opinions be known. Remember vour 
opinions should be b ased on last year's experience in school . 
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Thtre I0 a great deal being taught at my school that la useful for 
aa as a parson* 



Strongly 
Disagree 



Strofiisly 
Agree 



3 



4 



The teachers at my school do no^ aeem to know enough about vhat 
they're teaching. 

Strongly Strongly 
Dlsagrlee Agree 



4 



The facilities at my school are old and out -dated. 



Strongly 
Disagree 



Strongly 
Agree 



3 



I We learned a lot from my school program. 



Strongly 
Disagree 



Strongly 
Agree 



3 

I 



My school counseling program has shown me some Ihteresting things 
about different careers. 



Strongly 
Disagree 

II 



Strongly 
Agree 



\ 2 



Ify school has a lot of books and equipment that I can use to help 
myself learn. ^ 

Strongly Strongly 
Disagree Agree 



The experiences I get in my school learning sessions have not 
really helped me to learn. 



Strongly 
Disagree 



Strongly 
Agree 
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Hoat of the courses In school are useful. 

Strongly r Strongly 

Disagrte „ Agree 

2 3 4 



Hot enough of the courses I We taken at my s<Aool have helped me 
decide wh^t I want to do when J graduate. 

Strongly Stl^ongly 

Disagree Agree 



There are very few people and places In my school that I can go 
to when I have a personal problem. 

Strongly Strongly 
Disagree Agree 



\ 



I do not get a chance to learn things at my own speed In school, 
Strongly Strongly 
Disagree Agree 

12 3 A 5 



People in school, like my teachers, have helped me in the last 
year. ' 

Strongly Strongly 
Disagree Agree 



3 4 

J 



I'd say school was really worthwhile. 



Strongly Strongly 
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15. 



r 

School doesn't teach me the things I really need to know. 
Strongly StronRly 



Disagree 
1 . 2 



Agree 
5 



16. 



The teachers and counselors at my school seem to really like 
'students. 



Strongly 
Disagree 



Strongly 
Agree 



17. 



I have trouble paying attention In school because the courses are 
not Interesting enough. 

Strongly . Strongly 

Disagree Agree 



18. 



My school does not have very good equipment to help learning. 

Strongly Strongly 
Disagree Agree . 



19, 



The counaellhg progren at my school ha* been good for me, 



Strongly 
Disagree 



Strongly 
Agree 



3 
I 



20. 



My school's counseling program Is helping me shape a good future 
for mysfelf . 

Strongly , Strongly 
Disagree Agree 



3 



21* I need Xf> go to school, to get a good Job. 

Strongly Strongly 
Disagree Agree 
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Wlth a few^exceptlona, the teachers at my achool are good teachers, 

Strongly Strongly 
Disagree Agree 



I used many new materials to help me In my school work. 



Strongly 
Disagree 



Strongly 
Agree 



My school uses- a variety of ways to help us learn - not Just a 
classroom and teacher. t 

Strongly Strongly 
Dl^gree Agree 



.^g 

1 



3 

J_ 



I have not really enjoyed most of the school courses that I have 
taken. 

Strongly Strongly 
\ Disagree ' ^ Agree 



I "have not learned much from my school counseling program^; 
' Strongly Strongly 



Disagree 

li . 2 



4 



Agree 

5 



Some of the Ideas I've gotten In school have helped me get 
Interested In some new area. 

Strongly 
Disagree 



Strongly 
Agree , 



3 



School haa ^alwaya been boring • I can hardly wal^t until I'm out. 



Strongly 
Disagree 



Strongly 
Agree 
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Educttlon, even vocational education, doesn't help with your 
Job when you leave school. ^ 



Strongly 
Disagree 



^Strongly 
Agree 



• 2 



ify parents are not very excited about the education I am getting. 

Strongly Strongly 
Disagree Agree 



4 



J- 



I think my school experience will help me get a good Job. 

Strongly / Strongly . 

Disagree ^' Agree " ® 



Hy school program, in general, has not been very good. 

Strongly Strongly 

Agree* 



Disagree 

1 2 



3 



Much of -what I learn in school I can use in a Job. 

. , Strongly < " Strongly 

» Disagree Agree 



± 



I don't like to iise the library very much.' 

Strongly • . Siioiifilv 

' Disagree ... ^^^^ . 

|1 2 3 4,5 

* I 



I like school because I learn a lof of new things there. 



Strongly 
Disagree 



Strongly 
Agree 



ACADEMY FOR CAREER EDUCATION 



Name: ' Date: 



Id 



ASSESSMENT OF . ST()DENT ATTITUDES i 
- POSTTEST INSTRUCTIONS 

In developing your school program and pj^nrflng for the future It Is 
important to know what studeiTits think about various aspects of/thelr 
education. ^ This questionnaire has been designed to give yoii an opportunity 
to ^press your opinions about several fairly ^^eneral educational issued 
based on your experience in schools It is not a test. ^. 

Please read each item carefully and think about your experiences in 
school this year in terms of what the £tem say^s. For each item circle 
the number on the scale below which showd^ the extent of your agreenc^t 
or d^agreement with, the statement. If your circle a higher number (4 or ' 
5), it mean& that yoii agree with what the statement says. If ySti circle ^ 
a low^ number ^1 or 2), it means that you disagree. If you circle a num- 
;ber (3) at the middle of the scale^ it means that you're not sure how 
much you agree or disagree. « |( 

This is not a test and there are^ no right or wrong answers. Your 
honest* opinions will be appreciated and helpful in improving £he school * 
program. All a^l^wers will be kept confidential. If you have any ques-r 
tlons, please raise your hand^for assistance. 



43. I like to l«arn about alo't of different subjects. 

: , Strongly ^ • Strongly 

. Disagree Agree. 

1. 2 3 4 5 1 

1.: J ' 

44. I learn a lot by doing new things outside of.ftchool. 

Strongly Strongly" 
Disagree . . Agree > 



45 .'^ I don't usjually read the newspaper every day. 

- Strongly ' S^ongly 

Disagree / Agree 

2 3 4! 

. I 



46. Most of vha£.^my school h«s taught me has not been of much use. *> 

. . Strongly ' . ^ * • > Strongly J ' 

Disagree * Agree' * 



2 3 

i ' \ 



47. The teachers I had In my school were not very interesting. 

Strongly " StCongly 

Disagree ' Agree 

1 2 3 4 • 5 I • 



48. Changes in 'school programs are usually not^^ood ones. 

• ^ . Strongly ^ ^ Strongly 

Disagree Agree 

2 3 ' 4 . : 



49. School, in general. Is not doing enough to prepare me for the life 
I'll lead after I. graduate. , ; 

Strongly * - ' Stroifgly 

' Disagree , >gree ^ 
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50. My .chool •xp«rlcnce will probably htlp mm g«t ahead latar oo. 



Strongly 
DisagYee 



11 



Strongly 
Agree 



2 3 4 
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ACADEMY FOR CAREER EDUCATION 



Name: ' Date: 



\ ASSESSMENT 0F .ST<JDENT ATTITUDES i 
' - ■ 
. - P13STTEST INSTRUCTIONS 

^ "* # 

In developing your school program a^d pi^nrflng for the future it is 
important to know what students think about various aspects of^ 'their 
education. This questionnaire has been designed to give you an opportunity 
to ^press your opinions abo'ut ^several f alrly^eneral educational issued 
based on your experience in school It is not a test. . , 

» ^ J ' 

t ' ' ' - » 

• ■ * 

Please read each item carefully and think about your experiences in 
school this year in terms of what the Item says. For each item circle^^ 
the number on the scale below which shows^ the extent of your agreemcgnt 

or d^agreement with, the statement. If your circle a higher number (4 or ' 

' , . ' ' ' ' - ' ' ^ ' 
. 5), it means, that you agree wit^h what the statement says. If ySd' circle ^ 

a low^ number (1 or 2), It means that you disagree. If you circle a num- 

^ber (3) at the middle of the scale^ it means t^at you're not sure how^ , ^ 

* much you agree or disagree « . " i( 

This is not a t^t and there are* no right or wrong answers. Your 

honesf opinions will be appreciated and helpful in improving ifhe school * 

program. All aih^wers will be kept confidential. If you have any ques^ 

"* ^ - - - ' 

t ions, please raise your hand for assistance. 



( 



(28.) School has always been boring - I can hardly wait until I'm out. 

Strongly " Str ly 

Disagree / Agree 



* 1. 2 3 ; -4 . 5" 



(50 My school counseling^ program ha8\8hown me some interest!^ things 
about different careers/ \ — \. . 

' * . Strongly, ■ . . / . Strongly ^ 

f Disagree Agree' 

I 2 3 A 5 

V I ^ 

( 6.) My school has a lot of books and equipment that I can use to help 
myaeijf learn • 

Strongly Strongly 
' ' Disagree Agi'ee 

1 2 ' 3"^V-' ' 4 ' 

'I 



(18.) My school does not have very good equipment to help learning. , 



Strongly , Strongly 
Difiagce|^ . 'Agree, 

2 3 - A. '51 

■ 1 I" 



(290 Education, even vocational, education, doesn't help with your 
Job when you leave school* 

Stjrongly . - Strongly 

Disagree , Agree 

I 1 2 3 A i : 

L 1 : 



(2^0 My school yses a variety of ways to help us learn - not just a 
• cJ.assr,oom and teacher. *• 
^Strongly Strongly 
. Disagree • . Agree ^ 

2 3 A : 
I 



7 0 the experiences I get in my schbol learning sessions have not' 
really helped me to learn. 

' Strongly ■ ^ [ Strongly-, 

bisagtee Agree ' 



|1 2 .3 ^ 



3 



8* (27.) Some of the ideas I've gotten in school have helped me get ; 
interested in some n^w area* * r 

' ' ^ ' Strongly Strongly 
Disagree ^ Agree ' 

2 3 • . 4 . 5;| . . 

: ! ' 



\9. (42.) I eniey teaching things to others. 

' , Strongly , Strongly 



Disagree Agree 



r * 

/ 

/ 



10. (34.) I don't like to use the library very much. 

Strongly * Strongly 

/ * • ■ Disagree ' ' • , Agree 

<r - 

1 2 3 4 ; 
I ^ 

11. (44.) I learn a lot by doing new' things outside .of school. 

« _ Strongly .. Strongly 

' . Disagree Agree 

1. 2 3 4 5 1. 
— I - i 



12. (45.) I don't usually^ read' the ^newspaper every day. 

Strongly' Strongly 
Disagree Agree 

2 3 4 : 



13. "(22.) With a few exceptions, the teachers at my 'school are good teachers. 

Strongly " Strongly 

. , Disagree Agree 



14. (19.) The counseling program at my school has been good for me. 

. Strongly , Strongly 
Disagree Agree , 

2 3 4; 



15. (37.) Not much ol the advice I have gotten in my 'school has helped me 
decide on what I want for my futur^. 

Strongly ' ^ . Strongly ' ' 

Disagree ' Agree 




• ■ . ' ^ -123- 2 

16. ( 8.) Most of the courses in school are usefuli 

Strongly Strongly 
Disagree Agree 

2 3 " A '5 



17. (3'3;) Much of vhat I- learn in .school I can use in a. job. 

Strongly Strongly 
' . Disagree . , . . Agr^e 

18. (13.) I'd say school was really worthwhile. 

Strongly Strongly 
Disagree Agree 



19. (35.) I like school because I learn a lot of new things there. 

Strongly Strongly 
* Disagree - Agree 



20. (43.) I like to learn about alo.t of different subjects. 

Strongly ^ Strongly 
Disagree "Agree 

2 3 4 I 

I 



21. (40 I*ve learned a lot, from my school program. 

Strongly Strongly 
Disagree Agree 

112 3 4 5 1 



22. (3.) The facilities at my school are old and out-dated. 

Strongly Strongly, 
Disagree Agree 



23. (32.) My school program, in general, has not been very good. 

Strongly . , Strongly 
, Disagree Agree 



24.. ( 1.) There Is a great deal being taught at my school that is useful 
for me as a person. ' 



Strongly 
Disagree 



Strongly 
Agree 



(lO.) 



There are very few people and places in my school that I can go 
t6 when I have a personal problem. 



Strongly 
Disagree 



Strongly . 
Agree 



3 



4 



(49.) 



School, in general, is not doing enough to prepare me for the life 
Ijil le^d after I graduate. 

Strorigly , Strongly 

Disagree . Agr^e 



3 

± 



5 



,( 2.) 



The teachers at my schSbl do not seen} to' know enough about what 
they*re teaching. 



Strongly 
Disagree ' 



Strongly 
Agree 



4 



The teachers I had in my school were not very Interesting. 
Strongly ^ Strongly 

Disagre^e Agree 



3 



4 
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The people who run my school probably do not enjoy what they^re 
doing . ^ 

Strongly Strongly 
Disagree Agree 



2. 



3 



Op.) riy school^s counseling program Isn^t really helping me get ready 
Eor things 1*11 do after I graduate. 



Strongly 
Disagree 



Strongly ^ 
Agree 



3 

J_ 
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31, 



(30.) My parents arc not very excited about tl\e education I am getting. 

Strongly Strongly ^ 

A Disagree " Agree 



32. 



(23.) I uset^many new materials to help me in my school work. 
Strongly . . Strongly 

Disagree • Agree 



3 

J_ 



V 
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ACADEWr FOR CAREER CDUCATIffl 



POST-TKSr 



ASSESS^€NT OF STUDENT- ATTITUDE SCALE 
SCORING SHEET 



ID# 



SUBTEST 1 - ACClCude Toward 
Education In Central 



ITIM 


SCORE 


1.^4 


X ■ 


2' 12 


X ■ 


3. 21 ^ 


X ■ 


4. 27 


X ■ • 


S. 28 


6-x ■ 


6. 30 


6-x ■ 


7. 32 


6-x ■ 


8. 35 


X ■ 


9. 48 


6-x ■ 


10. 49 


6-x ■ 


TOTAL 


. □ - 


MEAN 





SUBTEST 2 - Attitude Toward 



School Currlculus 



ITEM 



SCORE 



1. 


1 


X 


■ 


2. 


7 


6-x 


■ 


3. 


8 


X 


■ 


A. 


9 


6-x 


m 


5. 


11 


' 6-x 


m 


6. 


14 


X 


m 




i5, ' 


6-x 


m 


8.* 


17 


6-x 


m 


9. 


25 . 


6-X 


m 


10. 


29 


6-x 


m 


11. 


31 


X 


m" 


12. 


33 


X 


m 


13. 


39 


X 




14.-40 


X 


m 


15.. 


41 


6-x 


m 


16. 




6-x 


m 


17. 


50 


^ X 





TOTAL 
MIAN 



□ 



Grand Total Scora ■ 
Overall Itean Score 



SUBTEST 3 - Attitude Toward 
School Beaourcea 
SCORE 



ITEM 






1. 2 


6-x, 


■ 


-2. 3 


6-X 


■ 


3. 6 


X 


■ 


4. 13 


X 


■ 


5. 18 


6-x 


■ 


6. 22 


X 


■ 




X 


■ 


8. 24^ 


^^^^ X 


■ 


9. 36 


6^x 


■ 


10. A7 


6-x 


■ 


TOTAL 




■ 


MEAN 




m 



□ 



SUBTEST 4 - Attitude Toward 
School Counaellng 



ITEM 

.1. 5 

2. 10 

3. 16 

4. 19 

5. 20 

6. 26 

7. 37 

8. 38 

TOTAL 



SCORE 



x 
6-x 
x 
x 

6-x 
6-x 
6-x 



. n 

□ 



SUBTEST S - Attitude Toward 



Learning 



ITEM 

1. 34 

2. 42 

3. 43 
'4. 44 

5. 45 

TOTAL 
MEAN 



SCORE 



6-x ■ 
x ■ 
x ■ 

" X «■ 
6-x 



□ 
□ 



\ 



ACADEMY/ FOR CAREER EDUCATION 

- •■' / . ' * 

Career Exploration Student Questionnaire 



This quest ionnaire^is an opportunity for you to evaltiate the Career 
Exploration Emplxiyer coulisse that you. are currently finishing. Please 
fill in the nai^ of the employer and^ the dates of thc^ employer course. 
Your Counselor /Coordinator .will have a list of the dates for you. 



Name of Exploration 



Date Exploration Began 
Date Es^loration Ended 



Beloir^b^ Statements regarding the last employer course you coiq>leted* 
Based otr.a 5-point scale » rate each statement from 1 (very poor) to 5 
(very ^^gobd) • Circle* your answer. In, the spac/^ provided » please indicat 
why you ratecl each statement the way you did. " ^ 



(1) The course was well « organized. 



J I — L 



1 . ; 2> :> 3 ^ ^ 5 
Very ^ ' Average Very 
Poor Good 



Explain: 



(2) This is the kind of place where, I might like to work. 

I ■ I I L 

1 2 3 A 5 

Very Average ■ Very 

Poor Good 



Explain: 



fas 



-lis-. 



I 



(3) I got to actually do things rather than just listen. 



1 2 3 4 5 
Very Average Very 

Poor Good 



Explain: 



(4) I enjoyed the program. 



-L 



1 2.3 4 5 
Very Ave rage Ve ry 

Poor Good 



Explain: 



(5) The employer personnel involved In the course were aware of the 
needs and interests of the students. 



J 1 L 



1 2 3 ,4.5 
Very Average Very 

Poor Good 



Explain: 



V 1 

(6) The employees involved with the students were Interested in \ • 

giving t^e course. , , \ 

\ ^ I I — : — L 

' .1 2 ' 3 4 ^ 

^ Very Average Very 

Poor ^ Good ^ 



Explain:' 



(7) . Indicate and explain tl\e rating that best describes your overall 
' general evaluation of this femployer course. 



4- 



1 2 3 4 5 
Very Avarage Viery. 

Poor Good 



Explain: 



Were there any jobs you learned .about In this employer course that 
really interested you? What were they and why did you like them? 



\ 

3 '■' . '/ 
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Was there anything* in particular that you liked about: thla employer 

course? ^ 



Was there anything In particular, you disliked about this employer 
course? 



Was this Exploration Cluster your first choice? 
□ Yes Dno 



\ 



Employer Questionna^ire 



Name of 



responde|it 



Title of respondent 

i 

" Name of company 

Type of coinpanyi 

Address of comj^y ^ 



Number of emplpyees in the company ^ : — J— 

Number of employees at the experience site ^ : 

Length of time respondent has been participating with the Career Education Program 



1. When the student is at your site^ approximately how many hours do you. tyjiically 
spend with a student? (Man hours per week) 



Number of hours. 



2. Which of the^ following supportive services do you (or others ^t your site) provide 
for the career Education Program (CEP) students? Check each appropriate category. 



C^reet Career 
Exploration Special- 
ization 



Do you talk about 3^ opportunities? 

DO'^'you tajk 5Qx>ut the jstudents' personed. problems? 

Do you talk about activities at your site? 

Do you tutor ' an academic area? 

Do you evaluate individual students' assignments? 

Do "you assist students in non-job related assignments? 

Do you supervise students, to perform a specific job- 
related task at your site'? 

Do you help plan student assignments? 



-132- 



3. ^'How do j%tudents spend their^iine at your site? . Indicate the approximate number 
of hours^per week for each category. If they ^re doing more than one thing at 
the same time, split the hours accordingly. ^ 



Observing site* activities 
Researching from site materials 
Actively performing site activities 
Talking with me 

Talking* with other site personnel 
Individual study 

Other (specify) 



Carieer Career 
Explora.tlon ^ 'Sp^cial- 
V Izatlon 



How did you 'become involved with the Career T:ducation Program? Chedc ^appropriate 
response (s) . * • " , , t 

_Jl^ EBCE personnel contacted me about the program T , * * 

A student talked to me about the program. 

Another employer talked to me about the program. , 

9 

^ Company personnel talked to me about the program. ^ 

. Other (specify)- ^ * . . ' 



5. Why did you become involved with the program? 



r 



6.* Did th^ Career Education Program staff provide you with enough ^information to help 
you to direct student activities at your site? \ ^ .« , 

<• ^ ' V 

, yes no ' ^ " 



If you answered rto, what information would have been helpful? 



ERIC * ' ; 



-133- 



7\ Wbuld you recoiwnend t^o another person (potential employer -or re source'' person) that 
he/she also become involved with Career Education Program?- 



yes 



no 



why? 



8, Describe the , type of pe|son you think should tJe involved with Career Educa^tion 
Program students.. ' • ^ . . ^ ^ , . 

■ ... V . . /\ >; ■ 



9, 



To what extent has the Career , Education Program had an impact on the following 



items? 



Quality of work^ 
performed by 
regular employees 

Amount of work 
performed by / ' 
regular employees 

Coippany hiring 
practices 

;d. Company training 
, practices 

e. List other possible 
impacts " • " 



No 



How Much Impact 
Some MuQh Don't 



Impac t Impac't Iinpac t 



Know 



Value of Impact 
Good Bad Don't, 
^Impact Impact Know * 



10 • 



Xn general, do you think the Career Education Program students yotJ^ havp v^rked with are 
really interested in your si,te? Circle the appropriate nuii0j)er firom Kdefinitel^^ no) to 
5 (definitely yes). 



Definitely 
N6 



Definitely 
Yes 

. 5 . 
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, II. In general/ do you think the Caoreer Education Program studeats yo\i hava'%^rkaa wlth'^ 
are. really interested in the Career Education Program? ^'^'^ ** 



* Definitely 
n6 n 



Definitely ' 
/Yes 



4 



12."^ How have employees at vour site reacted to participation iix^the Career Education 
Program? Check one. . Ij \ " . . • ^ ^ * . 



Positive reaction/ 
Ne^tive reaction 
Mixed reaction 



No reaction 
Mot applicable 
Don't know ^ 



13. In wh'at ways (if any) have the employees at^your site benefited? Check appropirlate 
ipesppnse (s) . ' • * ^ ' , * * * 

. They naveri ' benefited ^ ^ ' 

Increased ^their awareness of youth 

Motivated the regular employees to further training < ^ 

^ • . Reduced Jbheir .workload " ^ ' . . . 
, Increased interest in their own woric ^ 
I» don ' t •know ^ - 
Other ^ (please specify) 



14. Do Y^u receive adequate feedback vabout what happens to the students after t:hey 
leave your sii;e? Circl^e the appropriate nuxaber from 1 (never) « to 5 (always). 



Never 

1 . 



Always 

,5 



15. rT)o yoU' r^eceive adequate feedMck about the effectiveness of yo.ur work with . 
the stucients? • ^ ^ 



Never 



4 . 



Always 
• 5 



16. How<many timed and ways have you communicated with staff during tbiis^ school year? 
• Check as many, as apply. ^ . ^ * , 



Almost every. day ^ 
Once or twice a week 



IndivicjMl Group 

Meeting Meetings Telephone Corresponderce 



On&e or twice a mdnth 
Less than once *a year 



Q / Never 
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17.' Below are 'listed several area of possible importance for a student to 
' Please rate each in terms of how important you feel it is for a student" 
to learn, and how well you feel the program is' accomplishing each. 



Students learn* to: 

a. -Perform specific occupational skills 

b. Be' punotuaL 4nd . organize their time 

*c. 'Ass\jun§ responsibility for themselves 

** ' ♦ , > » 

d. Make decisions etxid follow through 

, e. Commun/cate with others in ^ 
loature way 

f . Be aware of more career ^ 
"Opportunities 

g. Work, with others 

h. Evaluate^ their own work 

i. . ,Perfo3Cin basic academic skills 

j. ^^Think throug;h and solve problems • ' 

k. Have a realistic attitude, toward ^ 
, self . ^ . " 

1. Have a positive attitude toward 

m. Have a positive 'attitude toward 
learning ** , ' 

n. Prepare for*further education 

o. Improve interpersonal and- social 
, skills . 

4 

p. other (please specify) 











1 

How Important Do 


You Feel This. • 


Learning Is? 


Not 






Highly 


Impor- 




Impor- 


" tant 




tant 


1 


2 


3 


1 ■ 5 


1 


2 


3 


4 5 


1 


.2 


3 


4 5 


1 


2 


3 • 


4 -5 

« 


y 








1 
L 




3^4^ 5 












2 


3 


4 5 




2 


3 




1 


2 


3. 


•'4 .s/ 








/ 


x'\ 


'2' 


. 3 




1 


2 


3 


4/5 










1 


;i 


3 




JL •■ 


2 


3 








1 




1 


*2 


•/ 


4 5 














> 




1 


2 


. 3 


4 5 


1 


2 

/' 


3 


4 5 


1' 




3 


. 4" 5 




> 







Ho\r Effective Do 
You Feel the Pro- 
ject Has Been in 
Accomplishing 
This Learning 



Not 

'E^^ec- 



tive 



2 
2 
2 
2 
2 



2' 
2 

.2 ^ 
2. 



2 
2 



Highly 
Effec- 
tive 



3' 

3 

3 

o 

3 



4 

4 
4 
4 



-4 



4 



3 

3 • 4 

3' •:,4 

3 4 

.3 4 



5 
5 
5 ' 
5 . 
5 



S 
5 
5 
5 
5. 



f 3 4 5 



3 4 5 



3-4 5 



3 4 5- 



3 4/5 



18. Dc you plan to continue participating in the Career. Educati"on P-"'»-n^am? 
Yes : , No V Don't Know 



Why: 




t9. What do you think are c the greatest strengths of the Career Education Program? 



.'20. What do you think are the greatest wellnesses of the Career Education Program? 



21. 



What other comments or recommendations about the Career Education Program would you 
like to make? " , ^ 
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MEMORANDUM 



TO: 



FROM: 



SUBJECT: 



DATE: 



Mary Ann Millsap 

Careei; Education Program 

National Institute for= Education 

Washington! D.C. ^ ' 

Rusis'ell A". Dusewicz, Ph.Di^ 
Independent Auditor 

* • ♦A 

AUDIT REPORT OF RBS CAREER EDUCATION PROGRAM 
EVALUATION ACTIVITIES 

V 

September 25, 1974 



This report, in memorandum form, is based upon: a systematic auditing of 
the procedures undertaken by the RBS Career Education Program in, year-end- 
evaluation; verification of data collection and processing; review of analytic 
techniques; and assessment of the appropriateness ot reported results and 
conclusions* Specifically excluded from the responsibilities of this audit are 
those areas involving judgements on: evaluation design; program objectives; < 
instrumentation; program operations; and "[the natut^ of the data collected. 



^ Within the predefined scope of this work are the >specif ic considerations 
of .the following types, which are listed Immediately below and treated topically 
in the balance of this report • > 

1. Appropriateness of Posttesting Cqntent and Procedures. 

2. Accuracy of Data Collection aiTd Processing. 

3^ Verification of Description Statistics in Final Report. 
4. Apprppriateness'of Analytic Techniques Applied. ^ 



5. Appropriateness 



of Coiiclb^ions. 



It should be noted that final drafting and reproductions of the Final Report 
was still in process at the time portions of this audit were completed which 
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made the review process more difficult, although sufficient Infonnatlon, and 
a final draft copy of the Report were made available for audit purposes. 

1. Appropriateness of Posttestlng Content and Procedures^ 

Design considerations aside, the testing phase of the Career Education 
Prdgram appeared to be sufficiently appropriate in content to enable collec- 
tion of data representativ'e'of variables to be. used for both descriptive and " 
Inferential statlstifcal purposes. It wasL. also de^emed gei^rally appropriate 
from a procedural standpoint, although some reservations mlght^ be expressed 
concerning the timing of pre- and posttestlng which is, some Instances produced 
sizable differences across groups in terms of inter-test Intervals. 

2^ Accuracy of^Data Collection and Processing . 

Verification of data collection and processing was attempted vil^^^^oljectiua 
and rescoring of both pre- and posttests on the 8TBS for a random sample of 
students. Ten students were so selected from the tpnth and eleventh grades a 
well as an additional ten students from the twelfth gr^de. 

In the twelfth grade sample, two pretest errors were found: a two-point 
error for one student on one of the CTBS subtests; and a one-point error for 
one student on another CTBS subtest. !^n the tenth-eleventh grade sample, the 
. following additional errors were found; a one-point error for two ydlf fer^t 
students on one CTBS subtest; and a one-point error for another stuaenC on a. 
different CTBS subtest. Thus a total of, five different errors were uncovered 
in the scoring process. When accuracy of transcription from^ answer sheets to 
coding sheets' was reviewed-^,^ no errors could be detected for the sample cases. 
Keypunching was likewise verified against coding with the result that one 
additional error of one point was found on one ..of the\C^JBS subtests. Student 




transcripts also reviewed agciinst^ student summary sheetsxyith the result 

that no additional errors were found. • - ^ 

V 

.When reviewed in^erms of the extent of error over the number of scores* 
examined, it is foand^hat^^a total of six errors were uncovered when five sub- 
tests over two testing periods for twenty individuals were reviewed. Thus S ^. 
a total of six errors. in 200 scorings, or an error factor of 3%, was incurred 
as a result of-jcdllecting and processing of the data ir the sample studied 
.here is a^epresentative one. * . ^ ' 

The magnitude of a one- or two- point raw score error is rather insignifi- - 
cant in light of the ^rather large mean total raw scores for the r,roups studied , 
and, together with the low frequency of theirjaftfl^rrence and the absence of 
any apparent bias in the occurrence of errors across groups, would be of little 
consequence in terms* of the analyses undertaken and^ the conclusion^ drawn from 
their results. . - , . t . 

3. Verification of Descriptive Statistics. 

■ 5 ' -Si < 

It* is the opinion of this reviewer that the descriptive statistics presen^ted 

in tabular form. and in the text of the Final 'Report are nei,ther misleading nor 

-> , * \ 

inappropriate and adequately reflect . the types of , data collected, as well as 

» \ * " " ♦ 

accurately representing- the forms of descriptive statistical prof iles of the ' 

variables of- concern. It should be noted that although the accuracy of the 

collectioij and processing of data serving as input to many of these tables was . 

not investigated, no gross procedural errors appeared to have been made that 

wou!kd produce consequent significant distortions in the , descriptive statistics^ 

presekt^d. Moreover, no biases in collection 6r processing o^ these same 

data could be detected. • 

It is believed that any errors in data collection and processing which 

' i ^ ^ , r 

would affect t6,e reporting of the^d^scriptive statistics in the Final Report 
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were unsystematic in nature* contributing only, perhaps, to "a slinilarXy in- 

- - ; . ^ / ^ 

creaseld error variance ^ - . 

4>. Appropriateness of Analytic Techniques Applied. 

In examining the approp^riateness of the statistical techniques utilized 
in analyzing data on the CTBS*: CMI and ASA, no problems arise with respect 

to the* tise of the correlated t-test for within group pre- vs. posttest com- 

^ ' ' .\ . 

parisons. It i^ an appropriate'^and recpmrnended- procedure. The same maybe true 
in the cases for which covariance was used In making inter group comparisons, 
although two infrequently respected theoretical, problem's must be noted in 
view of the particular evaluation design employed here: non^random assignment 
across groups; and the unavailability of evidence on homogenity of regression. 
* Arguments, of course, can be made for the robustness of the covariance ^ 

techniques and for Its relative insensitivity to failure to meet some of its 
underlying assumptions, but reservations concerning violation of these assump- 
tions are nevertheless worth "noting, this is especially true in the present 
Instance. where random assignment did not occur, and no evidence of homogenity ' 
of regression is' offered in the Final Report. Studies of this type are always 
subject to Interpretation difficulties that are not present when random 
assignment is used in forming the groups.'' Even when analysis of covariance ' 
is^ skillfully used, pne can never be certain that some, variable that has been 
overlooked will not bias the evaluation. This problem is absent In properly 
randomized studies -because the effects of all uncontrolled variables are, 
distributed among the groups in such a way that they can be taken into account In 

the text of significance. , / • ^ ^ 

It should aiso be noted that the' conventional statistical confidence level 
of ^ine'ty-f ive> percent (p<,05) wais not used for hypothesis testing In the V.* 
evaluation of this pr6gram, but rather the somewhat less stringent ninety 

Er|c , ... ; • iA:^ 
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percent ( p<»10) level was the standard applied* This relaxation confidence 
level, while effectively increasing the chances of obtaining significaht' findings, 
is not> infrequently employed i'h other areas' of research where characteristically 
hfgh^ proportions of error variance are present in the measurements undertaken., 

5. Appropriateness of Conclusions . 

Aside from a consideration of certain reservations already expressed In 
earlier sections of this report ( admittedly not uncommon in evaluations of. 
educational programs), the treatment of hypotheses and conclusions reached in .the 
"Summative Evaluation"- section of the Final Report reflect an appropriate draw- 
ing of inferences from the statistical analyses performed on the relevant data. 
Given the limitations of , design and the pre-establi«hed confidence levels em- 
ployed in hypothesis testing,^ an accurate Interpretation of the results appears 
to have been made in those cases where inferential statistical techniques were 
utilized • 
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